-- Logs begin at Wed 2021-11-24 15:24:20 UTC, end at Wed 2021-11-24 16:30:08 UTC. -- Nov 24 15:57:00.350277 dv-cinder-818994-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 24 15:57:03.186727 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.common.config [-] Logging enabled! Nov 24 15:57:03.187446 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 15:57:03.187587 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102680) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 15:57:03.190859 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.common.config [-] Logging enabled! Nov 24 15:57:03.191122 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 15:57:03.191440 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102680) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 15:57:03.192413 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:57:03.192649 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:57:03.193052 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:57:03.193306 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:57:03.193537 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:57:03.193862 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.194294 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 24 15:57:03.194611 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.195440 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.195783 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.196283 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.196698 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.196995 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.197319 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.197626 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.197919 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.198208 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.198496 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.198795 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.199084 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.199379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.199669 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.199958 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] debug = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.200244 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.200691 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.201169 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.201457 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.201752 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.202037 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.202313 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.202590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.202881 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.203233 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] host = dv-cinder-818994-2-iscsi {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.203517 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.203806 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.204096 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.204385 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.204661 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.204939 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.205255 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.205544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.205806 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.206088 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.206401 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.206680 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.206976 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.207208 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.207439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.207793 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.208089 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.208373 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.208654 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.208934 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.209241 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.209524 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.209797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.210087 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.210380 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.211246 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.211533 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.211830 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.212304 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.212760 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.213066 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.213358 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.213640 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.214469 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.214469 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.214469 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.214807 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.215036 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.215328 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.215617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.215907 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.216187 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.216481 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.216757 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.217056 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.217331 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_json = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.217606 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.217880 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.218167 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.218445 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.218721 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.219000 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.219275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.219563 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:03.219866 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.220168 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.220474 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.220763 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.221098 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.221384 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.221677 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.221959 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.222252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.222544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.222840 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.223122 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.223415 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.223696 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.223997 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.224307 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.224616 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.224915 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.225215 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.225497 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.225777 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.226062 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.226573 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.227049 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.227361 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.227662 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.227952 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.228261 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.228559 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.228862 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.229191 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.229474 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.229758 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.230053 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.230332 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.230609 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.230891 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.231184 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.231464 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.231740 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.232025 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.232306 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.232584 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.232859 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.233166 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.233459 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.233738 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.234012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.234287 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.234563 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.234837 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.235124 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.235405 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.235679 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.235969 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.236231 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.236511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.236787 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.237197 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.237354 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.237631 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.237903 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.238177 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.238452 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.238727 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.239001 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.239274 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.239551 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.239830 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.240106 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.240379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.240654 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.240933 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.241231 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.241519 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.241967 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.242474 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.242780 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.243070 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.243354 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.243638 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.243921 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.244205 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.244490 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.244766 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.245087 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.245380 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.245670 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.245956 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.246270 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.246573 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.246855 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.247142 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.247422 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.247703 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.247991 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.248278 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.248576 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.248876 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.249202 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.249502 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.250077 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.250347 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.250661 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.250945 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:03.251164 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:57:03.251416 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102680) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 24 15:57:03.701160 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:57:03.701448 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:57:03.701761 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:57:03.702110 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 24 15:57:04.048120 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.048308 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.048579 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.049803 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.050079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.050464 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.088439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.088717 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.088983 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.104597 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.104880 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.105185 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.135785 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.136061 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.136334 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.175953 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.176250 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.176521 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.442956 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.443662 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.443662 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.443926 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.444450 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.547732 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.548062 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.548350 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.548629 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.548901 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.549254 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.549522 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.549784 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.550038 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.550328 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.550592 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.550859 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.551119 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.551376 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.551645 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.551909 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.552165 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.552548 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.553004 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.553460 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.553747 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.554014 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.554881 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.555652 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.555652 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.555892 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.556245 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.556493 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.556737 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.556979 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.557244 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.557485 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:04.557872 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 24 15:57:04.561317 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 24 15:57:04.565358 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 24 15:57:04.569224 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1000, 1049)])]) Nov 24 15:57:04.571912 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 24 15:57:04.572381 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 24 15:57:04.572723 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 24 15:57:04.573162 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 24 15:57:04.576065 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 24 15:57:04.576318 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 24 15:57:04.576673 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 15:57:04.582061 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 24 15:57:04.605491 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 24 15:57:04.605960 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.606268 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102680) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 24 15:57:04.606642 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.608042 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102680) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 24 15:57:04.608335 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 15:57:04.608583 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 24 15:57:04.613415 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.613702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:04.677084 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 24 15:57:04.677332 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 24 15:57:04.677573 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 24 15:57:04.677965 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 24 15:57:04.700200 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_db.sqlalchemy.engines [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:57:05.263443 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing driver for type 'gre' Nov 24 15:57:05.263974 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] gre ID ranges: [(1, 1000)] Nov 24 15:57:05.319809 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing driver for type 'local' Nov 24 15:57:05.320741 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing driver for type 'vlan' Nov 24 15:57:05.334904 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] VlanTypeDriver initialization complete Nov 24 15:57:05.335243 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing driver for type 'vxlan' Nov 24 15:57:05.335822 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] vxlan ID ranges: [(1, 1000)] Nov 24 15:57:05.393267 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing extension driver 'port_security' Nov 24 15:57:05.393611 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.extensions.port_security [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] PortSecurityExtensionDriver initialization complete Nov 24 15:57:05.393953 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing mechanism driver 'openvswitch' Nov 24 15:57:05.394292 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing mechanism driver 'hyperv' Nov 24 15:57:05.401425 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.plugin [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102680) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:05.402241 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.402634 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.402994 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.403547 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.403985 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.404344 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.404698 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.405133 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.405557 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.405912 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.406262 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.406662 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.407079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.407427 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.407767 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.408325 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.408746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.409141 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.409495 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.409902 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.410358 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > address_group after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.410709 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > address_group after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.411190 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > address_group after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.411577 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102680) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 15:57:05.412004 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] ML2 OVO RPC backend initialized. {{(pid=102680) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 24 15:57:05.412743 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.413141 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.413572 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.414134 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > networks before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.414749 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.415134 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > ports before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.415491 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.415841 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnets before_response 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.416198 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.416547 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.416892 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.417268 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.417610 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.417956 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.418297 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.418637 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.418974 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > subnet after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.419596 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.plugin [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Modular L2 Plugin initialization complete Nov 24 15:57:05.419932 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading services supported by the core plugin {{(pid=102680) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 24 15:57:05.420271 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.plugins.ml2.managers [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Got port-security extension from driver 'port_security' Nov 24 15:57:05.420742 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.extensions.vlantransparent [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Disabled vlantransparent extension. Nov 24 15:57:05.421259 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102680) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 24 15:57:05.421578 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: router Nov 24 15:57:05.462368 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.462993 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_create 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.463087 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router before_create 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.463411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.463793 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.464156 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_delete 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.464519 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > floatingip after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.464882 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > floatingip after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.465275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_create 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.465629 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.465985 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.466337 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.466698 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.467114 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.467487 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.467830 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.468171 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: subnet after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.468516 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.468867 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > port precommit_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.469255 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_create 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.469602 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.469950 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.470315 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router after_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.470664 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_delete 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.471022 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_create 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.471382 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router_interface after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.471728 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_update 55549900 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.472096 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > agent after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.472448 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > agent after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.472795 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > network after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.473756 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Tracking information for resource: router configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:05.474096 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Tracking information for resource: floatingip configured {{(pid=102680) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 15:57:05.480448 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.db.l3_agentschedulers_db [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 24 15:57:05.481051 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.481437 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.481793 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.482148 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: port after_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.482962 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router before_create 55550100 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.483333 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_delete 55550100 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.483700 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_create 55550100 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.484063 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > router precommit_update 55550100 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.489155 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.provider_configuration [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service providers = [] {{(pid=102680) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 24 15:57:05.489529 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.db.servicetype_db [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102680) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 24 15:57:05.493512 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.service_base [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102680) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 15:57:05.493873 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.service_base [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102680) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 15:57:05.494220 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.service_base [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102680) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 15:57:05.495133 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.services.service_base [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102680) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 15:57:05.495513 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.services.service_base [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 24 15:57:05.495910 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.496235 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 24 15:57:05.507605 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.508173 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: auto_allocate Nov 24 15:57:05.514210 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: network precommit_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.514589 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: network precommit_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.515125 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.515451 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: tag Nov 24 15:57:05.522390 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.522724 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: timestamp Nov 24 15:57:05.527457 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.527790 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: network_ip_availability Nov 24 15:57:05.533542 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.533923 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.534287 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.535060 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.535383 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: flavors Nov 24 15:57:05.541341 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.541675 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading Plugin: revisions Nov 24 15:57:05.546126 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102680) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 15:57:05.546534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.845s {{(pid=102680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:57:05.547318 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102680) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 24 15:57:05.547658 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Initializing extension manager. Nov 24 15:57:05.548182 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: __init__.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.548531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: __pycache__ {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.548873 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.549250 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: address_group.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.550047 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.550637 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: address-group Nov 24 15:57:05.550962 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: address_scope.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.553342 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.553885 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: address-scope Nov 24 15:57:05.554324 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: admin_state_down_before_update.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.555628 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.556154 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: router-admin-state-down-before-update Nov 24 15:57:05.556489 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: agent.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.557254 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.557773 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: agent Nov 24 15:57:05.558104 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: agent_resources_synced.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.559044 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.559562 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: agent-resources-synced Nov 24 15:57:05.559890 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: allowedaddresspairs.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.561779 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.562306 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: allowed-address-pairs Nov 24 15:57:05.562639 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: auto_allocated_topology.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.563733 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.564254 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: auto-allocated-topology Nov 24 15:57:05.564588 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: availability_zone.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.565319 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.565834 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: availability_zone Nov 24 15:57:05.566163 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: availability_zone_filter.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.567088 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.567599 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: availability_zone_filter Nov 24 15:57:05.567928 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: data_plane_status.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.568846 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.569388 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension data-plane-status not supported by any of loaded plugins Nov 24 15:57:05.569716 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: default_subnetpools.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.571513 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.572032 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: default-subnetpools Nov 24 15:57:05.572363 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: dhcpagentscheduler.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.573233 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.573749 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: dhcp_agent_scheduler Nov 24 15:57:05.574079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: dns.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.575023 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.575537 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension dns-integration not supported by any of loaded plugins Nov 24 15:57:05.575868 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: dns_domain_ports.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.576799 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.577349 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 24 15:57:05.577681 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.578633 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.579151 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 24 15:57:05.579479 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: dvr.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.580163 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.580675 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: dvr Nov 24 15:57:05.581002 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: ecmp_routes.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.581957 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.582467 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension ecmp_routes not supported by any of loaded plugins Nov 24 15:57:05.582792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: empty_string_filtering.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.583725 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.584237 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: empty-string-filtering Nov 24 15:57:05.584565 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.585645 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.586503 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 24 15:57:05.586854 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.587820 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.588335 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 24 15:57:05.588664 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: external_net.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.589620 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.590139 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: external-net Nov 24 15:57:05.590469 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: extra_dhcp_opt.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.591392 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.591908 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: extra_dhcp_opt Nov 24 15:57:05.592237 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: extraroute.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.593201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.593714 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: extraroute Nov 24 15:57:05.594041 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: extraroute_atomic.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.595116 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.595637 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: extraroute-atomic Nov 24 15:57:05.595967 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: filter_validation.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.596669 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.597221 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: filter-validation Nov 24 15:57:05.597549 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: fip_pf_description.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.598473 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.598985 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 24 15:57:05.599315 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: fip_port_details.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.600251 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.600765 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: fip-port-details Nov 24 15:57:05.601665 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: flavors.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.603230 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.603757 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: flavors Nov 24 15:57:05.604089 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.605842 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.606368 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 24 15:57:05.606700 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: floatingip_pools.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.607412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.607930 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: floatingip-pools Nov 24 15:57:05.608260 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: ip_allocation.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.609240 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.609766 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension ip_allocation not supported by any of loaded plugins Nov 24 15:57:05.610095 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.611024 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.611539 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: ip-substring-filtering Nov 24 15:57:05.611874 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l2_adjacency.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.612812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.613356 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension l2_adjacency not supported by any of loaded plugins Nov 24 15:57:05.613692 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.614893 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.615418 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: router Nov 24 15:57:05.615749 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3_conntrack_helper.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.618500 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.619037 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 24 15:57:05.619375 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.620332 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.620854 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: ext-gw-mode Nov 24 15:57:05.621222 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.622159 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.622677 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: l3-ha Nov 24 15:57:05.623009 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3_flavors.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.623932 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.624447 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: l3-flavors Nov 24 15:57:05.625046 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.625990 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.626511 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: l3-port-ip-change-not-allowed Nov 24 15:57:05.626835 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: l3agentscheduler.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.627907 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.628424 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: l3_agent_scheduler Nov 24 15:57:05.628756 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: local_ip.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.630605 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.631143 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension local_ip not supported by any of loaded plugins Nov 24 15:57:05.631483 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: logging.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.633777 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.634307 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension logging not supported by any of loaded plugins Nov 24 15:57:05.634645 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: metering.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.635412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.636003 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: metering Nov 24 15:57:05.636337 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.637493 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.638018 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: metering_source_and_destination_fields Nov 24 15:57:05.638345 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: multiprovidernet.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.639297 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.639819 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: multi-provider Nov 24 15:57:05.640148 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: netmtu.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.641115 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.641628 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: net-mtu Nov 24 15:57:05.641956 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: netmtu_writable.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.642888 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.643407 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: net-mtu-writable Nov 24 15:57:05.643735 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: network_availability_zone.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.644420 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.644928 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: network_availability_zone Nov 24 15:57:05.645277 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: network_ip_availability.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.646430 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.646948 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: network-ip-availability Nov 24 15:57:05.647278 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: network_segment_range.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.648281 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.649125 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension network-segment-range not supported by any of loaded plugins Nov 24 15:57:05.649466 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: pagination.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.650486 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.650982 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: pagination Nov 24 15:57:05.651312 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: port_device_profile.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.652246 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.652766 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: port-device-profile Nov 24 15:57:05.653119 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.654071 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.654583 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: port-mac-address-regenerate Nov 24 15:57:05.654909 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.655827 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.656336 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: port-numa-affinity-policy Nov 24 15:57:05.656661 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: port_resource_request.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.657620 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.658130 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension port-resource-request not supported by any of loaded plugins Nov 24 15:57:05.658452 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: port_resource_request_groups.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.659430 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.659947 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 24 15:57:05.660276 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: portbindings.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.661248 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.661763 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: binding Nov 24 15:57:05.662092 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: portbindings_extended.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.663429 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.664778 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: binding-extended Nov 24 15:57:05.665259 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: portsecurity.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.666211 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.666736 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: port-security Nov 24 15:57:05.667066 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: project_id.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.668066 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.668407 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: project-id Nov 24 15:57:05.668739 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: providernet.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.669724 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.670245 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: provider Nov 24 15:57:05.670570 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.674252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.674782 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos not supported by any of loaded plugins Nov 24 15:57:05.675118 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.676395 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.676919 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 24 15:57:05.677279 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.678212 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.678735 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 24 15:57:05.679065 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_default.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.680985 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.681535 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-default not supported by any of loaded plugins Nov 24 15:57:05.681871 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_fip.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.682549 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.683065 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-fip not supported by any of loaded plugins Nov 24 15:57:05.683395 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_gateway_ip.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.684369 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.684889 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 24 15:57:05.685317 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_port_network_policy.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.686255 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.686770 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 24 15:57:05.687099 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.688164 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.688678 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 24 15:57:05.689010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_pps_rule.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.690240 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.690760 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-pps not supported by any of loaded plugins Nov 24 15:57:05.691090 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_rule_type_details.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.692018 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.692530 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 24 15:57:05.692857 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: qos_rules_alias.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.693942 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.694457 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 24 15:57:05.694835 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: quota_check_limit.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.696060 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.696577 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: quota-check-limit Nov 24 15:57:05.696906 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: quotasv2.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.697931 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.698267 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: quotas Nov 24 15:57:05.698595 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: quotasv2_detail.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.702093 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.702444 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: quota_details Nov 24 15:57:05.702784 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: rbac.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.703911 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.704512 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: rbac-policies Nov 24 15:57:05.704850 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: rbac_address_group.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.705858 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.706386 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: rbac-address-group Nov 24 15:57:05.706713 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: rbac_address_scope.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.707647 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.708165 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: rbac-address-scope Nov 24 15:57:05.708493 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: rbac_security_groups.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.709457 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.709980 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: rbac-security-groups Nov 24 15:57:05.710308 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: rbac_subnetpool.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.711560 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.712082 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: rbac-subnetpool Nov 24 15:57:05.712459 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: revisionifmatch.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.713389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.713910 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: revision-if-match Nov 24 15:57:05.714233 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: revisions.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.715395 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.715978 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: standard-attr-revisions Nov 24 15:57:05.716339 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: router_availability_zone.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.717047 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.717604 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: router_availability_zone Nov 24 15:57:05.717904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: routerservicetype.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.718847 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.719359 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension router-service-type not supported by any of loaded plugins Nov 24 15:57:05.719685 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.720698 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.721247 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: security-groups-normalized-cidr Nov 24 15:57:05.721578 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: security_groups_port_filtering.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.722518 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.723037 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: port-security-groups-filtering Nov 24 15:57:05.723368 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.724309 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.724825 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: security-groups-remote-address-group Nov 24 15:57:05.725196 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.726819 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.727455 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: security-groups-shared-filtering Nov 24 15:57:05.727825 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.728449 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 24 15:57:05.728775 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: securitygroup.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.738870 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.739417 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: security-group Nov 24 15:57:05.739761 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: segment.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.740571 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.741108 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension segment not supported by any of loaded plugins Nov 24 15:57:05.741444 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.743307 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.743837 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 24 15:57:05.744167 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: servicetype.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.745335 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.745864 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: service-type Nov 24 15:57:05.746204 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: sorting.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.747200 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.747541 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: sorting Nov 24 15:57:05.747873 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: standard_attr_segment.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.748812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.749367 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 24 15:57:05.749965 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: standardattrdescription.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.750654 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.751184 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: standard-attr-description Nov 24 15:57:05.751513 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: stateful_security_group.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.752484 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.753004 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: stateful-security-group Nov 24 15:57:05.753355 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: stdattrs_common.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.753939 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 24 15:57:05.754266 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.755230 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.755744 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 24 15:57:05.756070 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnet_onboard.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.757210 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.757932 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: subnet_onboard Nov 24 15:57:05.758443 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.759397 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.759913 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 24 15:57:05.760243 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnet_service_types.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.761228 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.761754 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: subnet-service-types Nov 24 15:57:05.762082 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnetallocation.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.763196 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.763718 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: subnet_allocation Nov 24 15:57:05.764050 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.764736 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.765278 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: subnetpool-prefix-ops Nov 24 15:57:05.765607 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.766567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.767081 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 24 15:57:05.767411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: tagging.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.768527 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.769069 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: standard-attr-tag Nov 24 15:57:05.769412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: timestamp.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.770685 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.771207 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loaded extension: standard-attr-timestamp Nov 24 15:57:05.771538 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: trunk.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.772595 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.773202 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension trunk not supported by any of loaded plugins Nov 24 15:57:05.773765 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: trunk_details.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.774955 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.775499 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension trunk-details not supported by any of loaded plugins Nov 24 15:57:05.775830 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: uplink_status_propagation.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.776803 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.777367 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 24 15:57:05.777694 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Loading extension file: vlantransparent.py {{(pid=102680) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 15:57:05.778420 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102680) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 15:57:05.778941 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extension vlan-transparent not supported by any of loaded plugins Nov 24 15:57:05.781706 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:network Nov 24 15:57:05.782271 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnet Nov 24 15:57:05.782681 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 15:57:05.783092 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:port Nov 24 15:57:05.784464 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.784913 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service FLAVORS assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.785598 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.786032 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.786374 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:router Nov 24 15:57:05.786827 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:floatingip Nov 24 15:57:05.787346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service METERING assigned prefix: /metering {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.789474 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.790113 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.790527 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102680) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 15:57:05.791670 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 15:57:05.792128 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:security_group Nov 24 15:57:05.792583 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 15:57:05.793290 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service CORE assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.793628 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 15:57:05.793994 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] subnetpool is already registered Nov 24 15:57:05.794448 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service CORE assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.794778 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 15:57:05.795115 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] subnetpool is already registered Nov 24 15:57:05.797631 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.798077 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service FLAVORS assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.798675 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.799106 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.799452 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:router Nov 24 15:57:05.799806 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] router is already registered Nov 24 15:57:05.800227 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:floatingip Nov 24 15:57:05.800573 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] floatingip is already registered Nov 24 15:57:05.801072 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service METERING assigned prefix: /metering {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.801795 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 15:57:05.802130 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] rbac_policy is already registered Nov 24 15:57:05.802553 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:security_group Nov 24 15:57:05.802901 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] security_group is already registered Nov 24 15:57:05.803322 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 15:57:05.803660 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] security_group_rule is already registered Nov 24 15:57:05.804949 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service CORE assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.805558 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 15:57:05.806020 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] subnetpool is already registered Nov 24 15:57:05.806475 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.v2.resource_helper [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Service CORE assigned prefix: {{(pid=102680) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 15:57:05.806809 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 15:57:05.807149 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING neutron.quota.resource_registry [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] subnetpool is already registered Nov 24 15:57:05.807648 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: extensions {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.809237 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: address-groups {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.810725 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: address-scopes {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.812046 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: agents {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.813228 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: auto-allocated-topology {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.814492 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: availability_zones {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.815705 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: dhcp-networks {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.817271 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: dhcp-agents {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.818691 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: routers {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.822551 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: flavors {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.823792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: service_profiles {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.825011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: next_providers {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.826473 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: service_profiles {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.828014 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: floatingip-pools {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.829258 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: routers {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.831372 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: floatingips {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.832651 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: l3-routers {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.834078 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: l3-agents {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.836084 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: metering-labels {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.837702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: metering-label-rules {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.839004 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: network-ip-availabilities {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.840274 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: bindings {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.841965 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: quotas {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.843504 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: quotas {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.845065 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: rbac-policies {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.846359 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: security-groups {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.847636 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: security-group-rules {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.849051 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: service-providers {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.850275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: subnetpools {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.852643 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: subnetpools {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.854162 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.855841 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.857667 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.859419 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.861295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.863124 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.864793 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.866829 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.868926 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.870797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron.api.extensions [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Extended resource: tags {{(pid=102680) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 15:57:05.877177 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING keystonemiddleware.auth_token [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:57:05.881921 dv-cinder-818994-2-iscsi neutron-server[102680]: WARNING keystonemiddleware.auth_token [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:57:05.891227 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Acquired lock "singleton_lock" {{(pid=102680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 15:57:05.891707 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_concurrency.lockutils [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Releasing lock "singleton_lock" {{(pid=102680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 15:57:05.892373 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Starting 2 workers Nov 24 15:57:05.897234 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Started child 102787 {{(pid=102680) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 15:57:05.902914 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Started child 102788 {{(pid=102680) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 15:57:05.903480 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.904537 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO neutron.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Neutron service started, listening on 0.0.0.0:9696 Nov 24 15:57:05.905079 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [-] (102787) wsgi starting up on http://0.0.0.0:9696 Nov 24 15:57:05.905230 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Publish callbacks [] for process, before_spawn {{(pid=102680) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.907645 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Starting 1 workers Nov 24 15:57:05.908613 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.910147 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [-] (102788) wsgi starting up on http://0.0.0.0:9696 Nov 24 15:57:05.913072 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Started child 102789 {{(pid=102680) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 15:57:05.913718 dv-cinder-818994-2-iscsi neutron-server[102680]: INFO oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Starting 1 workers Nov 24 15:57:05.917399 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] calling RpcWorker wait() {{(pid=102789) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 24 15:57:05.918298 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] returning from RpcWorker wait() {{(pid=102789) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 24 15:57:05.918716 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Started child 102790 {{(pid=102680) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 15:57:05.919676 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG neutron_lib.callbacks.manager [None req-e4d9854c-4a30-439b-8fd2-b44ea7fe51ab None None] Publish callbacks [] for process, after_spawn {{(pid=102680) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.921647 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102680) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 15:57:05.921860 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:57:05.922239 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:57:05.922458 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:57:05.922986 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:57:05.923154 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:57:05.923679 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.924131 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.924407 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.924670 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.924989 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.925566 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.926399 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926399 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926399 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926399 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926935 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926935 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.926935 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.927269 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.927403 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.927694 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.928073 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:05.928291 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.928489 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.928686 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.928897 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:05.929695 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.929695 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.930090 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.930300 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.930627 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] debug = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.930964 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.931487 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.931738 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.931961 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.932230 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.932601 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.932835 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.933097 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.933346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.933514 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.933766 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.934025 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.934265 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.934607 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.934896 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.935117 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.935366 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.935634 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.936144 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] host = dv-cinder-818994-2-iscsi {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.936392 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.936611 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.936844 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.937129 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.937386 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.937598 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.937859 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.938106 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.938363 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.938596 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.938857 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.939121 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.939333 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.939588 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.939756 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_options = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.940023 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.940304 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.940566 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.940770 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.940943 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.941152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.941427 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.941593 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.941850 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.942062 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.942280 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.942493 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.942819 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.942987 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.943208 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.943482 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.943675 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.943894 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.944107 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.944335 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.944577 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.944863 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.945773 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.946060 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.946464 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.946752 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.946990 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.947215 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.947506 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.947687 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.947925 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.948197 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.948435 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.948671 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.948927 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.949184 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.949413 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.949631 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.949894 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.950123 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.950359 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.950615 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.950852 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.951100 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.951334 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.951583 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.951802 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_json = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.952035 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.952280 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.952533 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.952763 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.953060 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.953214 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.953439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.953684 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:05.954121 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.954404 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.954715 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.954967 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.955199 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.955439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.955676 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.955927 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.956245 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.956397 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.956714 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.956957 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.957294 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.957646 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.957786 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.958106 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.958367 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.958625 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.958863 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.959085 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.959318 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.959574 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.959853 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.960075 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.960331 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.960778 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.961206 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.961665 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.72/identity {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.963472 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.964630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.964630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.964961 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:05.965158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965738 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965738 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.965738 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.966324 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.966324 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.966816 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.966816 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.966816 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.967375 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.967375 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.967655 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.967655 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.968022 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.968158 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.968341 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.968620 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.968865 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.969133 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.969355 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.969572 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.969797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.970028 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.970246 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.970459 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.970678 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.970913 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.971128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.971379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.971595 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.971827 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.972059 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.972282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.972532 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.972746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.972957 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.973210 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.973544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.973701 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.973843 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.974051 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.974257 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.974490 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.974704 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.974916 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.975157 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.975387 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.975626 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.975863 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.976180 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.978356 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980272 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980735 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980735 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980735 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.980959 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.981339 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.982275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.982275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.982275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.982275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.982781 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.983238 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.983498 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.983889 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.984319 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.985275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.985275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.985275 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.987179 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.988172 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.988172 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.988172 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.988172 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.990201 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.993011 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.72/identity {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.996885 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:05.998463 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.000456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.002010 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.003977 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.004697 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.005510 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006079 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006817 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006817 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.006817 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.008180 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.008180 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.008180 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.008500 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.008945 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.009333 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.009513 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.009760 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.009995 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.010227 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.010442 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.010677 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.010907 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.011130 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.011352 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.011640 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.011828 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.012531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.013564 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.013564 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.013871 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.013871 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.014127 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.014313 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.014537 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.014845 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.015006 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.015209 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.015441 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.015649 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.015866 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.016086 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.016491 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.016705 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.016902 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.017833 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.017833 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.017833 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.018344 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.018344 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.018628 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.018628 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.018901 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.019163 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.019397 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.019644 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.020412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.020412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.020412 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.022719 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1000:1049'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.025544 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.026809 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.028295 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102680) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:57:06.030128 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.031590 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.032710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.034534 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] debug = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.035710 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.036531 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] host = dv-cinder-818994-2-iscsi {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.037530 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039161 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.039904 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_options = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040263 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040263 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040263 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040486 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040616 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040784 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.040947 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041134 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041297 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041457 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041777 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.041937 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.045109 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.045109 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.045109 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.045109 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046303 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 56986) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.046439 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.047389 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.049702 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_json = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.050617 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051426 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.051988 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.055511 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.057173 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.72/identity {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.058012 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.059282 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.060326 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.061746 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.062794 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.064152 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.065410 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.067924 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.069322 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.071462 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.071462 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.071462 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.071462 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.071978 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [-] 10.222.0.72 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0207531 Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.072138 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.073558 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.074630 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.076252 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.077428 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.72/identity {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.078434 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.078434 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.078854 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.078993 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.079123 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.079308 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.079477 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.080346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.080346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.080346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.080346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.080346 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081020 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081020 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081020 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081020 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081020 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.081797 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082422 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082422 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082422 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082422 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082791 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082791 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082993 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.082993 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083186 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083288 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083456 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083723 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083848 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.083967 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.084103 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.084220 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.084377 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.084536 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.084735 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.087411 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.088831 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.090262 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.090262 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.090262 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.091792 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.093379 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094188 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094188 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094188 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094188 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094188 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094677 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094677 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.094677 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095016 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095016 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095016 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095320 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095320 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095527 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095638 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095806 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.095963 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.096546 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.096546 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.096546 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.096546 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097171 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097171 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097171 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.097812 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098301 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098301 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098301 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098579 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098579 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.098750 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.099505 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.099505 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.099505 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.099505 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.099505 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1000:1049'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.101672 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.102741 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.104567 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.105891 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.105891 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.105891 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:57:06.105891 dv-cinder-818994-2-iscsi neutron-server[102680]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:57:06.130614 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:18.690403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb6e8ab9-099b-4af5-9f20-acd041f7a080 None None] get_active_networks_info from dv-cinder-818994-2-iscsi {{(pid=102789) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 15:57:18.759665 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb6e8ab9-099b-4af5-9f20-acd041f7a080 None None] No non-hosted networks {{(pid=102789) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 24 15:57:18.767388 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.agentschedulers_db [None req-fb6e8ab9-099b-4af5-9f20-acd041f7a080 None None] DHCP Agent not found on host dv-cinder-818994-2-iscsi {{(pid=102789) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 24 15:57:18.839377 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-90811bfc-d59b-4bd3-a45a-84a81747fddb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:21.224912 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b99b38e5-5efa-45f6-9201-bcf46e9104e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:21.302981 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fb327c46-6fbe-4866-966e-65fa5d3d1bc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:22.643912 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:24.305228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:24.306315 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.307155 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.307745 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.309106 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.309683 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.310237 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.310954 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.311508 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.312063 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.312636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.313313 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.313899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:24.315152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-818994-2-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:24.332837 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-818994-2-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:24.461681 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:25.895626 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57086) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:26.615088 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING oslo_policy.policy [None req-c09e8b25-75bb-4984-9f73-1e3c45865ead admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:26.616519 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING oslo_policy.policy [None req-c09e8b25-75bb-4984-9f73-1e3c45865ead admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:26.858448 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [None req-c09e8b25-75bb-4984-9f73-1e3c45865ead admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 15:57:26.859814 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c09e8b25-75bb-4984-9f73-1e3c45865ead admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.9619422 Nov 24 15:57:28.003684 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.db.l3_hamode_db [None req-34db4c71-3a00-426c-be05-ebe83cec8b88 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 24 15:57:28.086388 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34db4c71-3a00-426c-be05-ebe83cec8b88 None None] Routers set() bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:57:28.086776 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34db4c71-3a00-426c-be05-ebe83cec8b88 None None] Router IDs set() for agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 15:57:29.463347 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57102) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:29.855121 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'shared': True, 'is_default': True}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:57:29.959955 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.policy [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102787) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 15:57:30.007440 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING oslo_policy.policy [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:30.007860 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING oslo_policy.policy [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:30.016601 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.quota [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] Loaded quota_driver: . Nov 24 15:57:30.129850 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872024445', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872023882', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872045464', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872042641', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872049183', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8794872056508', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-679836', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-845559', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-33369623', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-33425901'] for rbac-policy, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:30.210183 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:30.211928 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8f87f854-5da9-4f58-924c-2d6f46166b54 admin admin] 10.222.0.72 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.7483270 Nov 24 15:57:32.995218 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57114) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:33.308087 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Request body: {'network': {'project_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'name': 'private'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:57:33.338350 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Made reservation on behalf of 15e538041c6b40d79499409143e5b7e5 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:57:33.341427 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.358616 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.536384 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.541082 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.561376 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1000} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:57:33.591248 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8794868623791', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.591860 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Unsubscribe: segment precommit_create {{(pid=102787) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 15:57:33.592373 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Added segment c1c1fe05-b0a6-43fd-b113-55cd6eb1af14 of type vlan for network 4bc2fa4b-98af-42f7-899c-bc24223d2927 Nov 24 15:57:33.609515 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80dcbadc-0c2f-46e2-b30a-1d8dfd3ad434,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:33.660493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.660864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.661237 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.661601 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.661979 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.662964 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.663348 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.663692 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.664035 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.664363 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.664686 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.665007 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Tracked resource versions report: Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: pushed versions: Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: { 'AddressGroup': {'1.2'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'ConntrackHelper': {'1.0'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Log': {'1.0'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Network': {'1.1'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Port': {'1.7'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'PortForwarding': {'1.2'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'QosPolicy': {'1.10'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroup': {'1.5'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroupRule': {'1.2'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SubPort': {'1.0'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Subnet': {'1.1'}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Trunk': {'1.1'}} Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: consumer versions: Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'ConntrackHelper': '1.0', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Log': '1.0', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Network': '1.1', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Port': '1.7', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'PortForwarding': '1.2', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'QosPolicy': '1.10', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroup': '1.5', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroupRule': '1.2', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SubPort': '1.0', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Subnet': '1.1', Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Trunk': '1.1'}} Nov 24 15:57:33.666074 dv-cinder-818994-2-iscsi neutron-server[102787]: {{(pid=102787) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 15:57:33.732087 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.780617 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.782063 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:57:33.782871 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:33.836486 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 0.8400488 Nov 24 15:57:33.892838 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8290cf9c-06ef-4ec0-b095-8a9bf9797e4f admin admin] Pushing event updated for resources: {'Network': ['ID=4bc2fa4b-98af-42f7-899c-bc24223d2927,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:33.907779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 15:57:36.669081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57128) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:37.133166 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92a7e821-37a4-4b22-b791-8f00169ec0c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:57:37.134566 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-92a7e821-37a4-4b22-b791-8f00169ec0c2 admin admin] 10.222.0.72 "GET /v2.0/networks/4bc2fa4b-98af-42f7-899c-bc24223d2927 HTTP/1.1" status: 200 len: 826 time: 0.4645255 Nov 24 15:57:37.159769 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-92e29328-3a97-4ee0-a03c-f2a47d3432da admin admin] 10.222.0.72 "GET /v2.0/subnetpools/3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf HTTP/1.1" status: 200 len: 734 time: 0.0191345 Nov 24 15:57:37.169891 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Request body: {'subnet': {'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf', 'ip_version': 4, 'name': 'private-subnet', 'gateway_ip': '172.20.0.1'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:57:37.197758 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Made reservation on behalf of 15e538041c6b40d79499409143e5b7e5 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:57:37.200418 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:37.510956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:37.586392 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Checking segment: {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 15:57:37.586781 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Network hostable DHCP agents. Network: 4bc2fa4b-98af-42f7-899c-bc24223d2927, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:57:37.591622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f751dd20-97f3-48d2-914c-f6c1a88ce24f,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:37.610720 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:57:37.624532 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 4bc2fa4b-98af-42f7-899c-bc24223d2927) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:57:37.629550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:57:37.630152 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:37.636655 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7306e57-e092-46c4-b555-40f526871eeb None None] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 15:57:37.646650 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-182c3a66-4b79-4ff1-81fe-8a3cf133ba39 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4800181 Nov 24 15:57:38.028756 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-4bc2fa4b-98af-42f7-899c-bc24223d2927', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 15:57:38.030133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.374929 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Allocated IP 172.20.0.2 (4bc2fa4b-98af-42f7-899c-bc24223d2927/f751dd20-97f3-48d2-914c-f6c1a88ce24f/d987a73b-9a85-4daa-837f-bdd643cc478c) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:57:38.597782 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.608142 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.691964 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:57:38.698137 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:57:38.701518 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:57:38.714070 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Pushing event updated for resources: {'Port': ['ID=d987a73b-9a85-4daa-837f-bdd643cc478c,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:38.763442 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.763806 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.764156 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.764503 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.764836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.765205 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.765536 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.765865 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.766209 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.766542 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.766860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.767181 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Tracked resource versions report: Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: pushed versions: Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: { 'AddressGroup': {'1.2'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'ConntrackHelper': {'1.0'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Log': {'1.0'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Network': {'1.1'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Port': {'1.7'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'PortForwarding': {'1.2'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'QosPolicy': {'1.10'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroup': {'1.5'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroupRule': {'1.2'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SubPort': {'1.0'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Subnet': {'1.1'}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Trunk': {'1.1'}} Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: consumer versions: Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'ConntrackHelper': '1.0', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Log': '1.0', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Network': '1.1', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Port': '1.7', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'PortForwarding': '1.2', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'QosPolicy': '1.10', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroup': '1.5', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroupRule': '1.2', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SubPort': '1.0', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Subnet': '1.1', Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Trunk': '1.1'}} Nov 24 15:57:38.768244 dv-cinder-818994-2-iscsi neutron-server[102789]: {{(pid=102789) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 15:57:38.809985 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Attempting to bind port d987a73b-9a85-4daa-837f-bdd643cc478c on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 15:57:38.810389 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Attempting to bind port d987a73b-9a85-4daa-837f-bdd643cc478c by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 15:57:38.810806 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Attempting to bind port d987a73b-9a85-4daa-837f-bdd643cc478c on network 4bc2fa4b-98af-42f7-899c-bc24223d2927 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 15:57:38.815922 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 57, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 15:57:38.816309 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Checking segment: {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 15:57:38.816787 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.817214 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Bound using segment: {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 15:57:38.817683 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Bound port: d987a73b-9a85-4daa-837f-bdd643cc478c, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 15:57:38.818532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.891701 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] For port d987a73b-9a85-4daa-837f-bdd643cc478c, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:57:38.897711 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] For port d987a73b-9a85-4daa-837f-bdd643cc478c, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=d987a73b-9a85-4daa-837f-bdd643cc478c,segment=NetworkSegment(c1c1fe05-b0a6-43fd-b113-55cd6eb1af14),segment_id=c1c1fe05-b0a6-43fd-b113-55cd6eb1af14)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:57:38.903026 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:38.976944 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dec952-2877-48d6-8fa4-9490afc05ba3 None None] Pushing event updated for resources: {'Port': ['ID=d987a73b-9a85-4daa-837f-bdd643cc478c,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:40.322609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57136) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:40.835250 dv-cinder-818994-2-iscsi neutron-server[102788]: WARNING oslo_policy.policy [None req-c9420898-a0ea-4756-be64-4308869149c3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:40.835837 dv-cinder-818994-2-iscsi neutron-server[102788]: WARNING oslo_policy.policy [None req-c9420898-a0ea-4756-be64-4308869149c3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:41.059927 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [None req-c9420898-a0ea-4756-be64-4308869149c3 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 15:57:41.061056 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c9420898-a0ea-4756-be64-4308869149c3 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7374966 Nov 24 15:57:43.649440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57150) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:43.993635 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [None req-ce973c44-f727-4d93-aef7-8c2f8df4d463 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 15:57:43.994616 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ce973c44-f727-4d93-aef7-8c2f8df4d463 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3442290 Nov 24 15:57:46.837922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57162) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:47.162828 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Request body: {'router': {'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'name': 'router1', 'admin_state_up': True}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:57:47.189458 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:47.191080 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:47.370264 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:47.375313 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:47.390993 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:47.392230 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ae270b90-9181-4e09-aab7-7e8919156d43 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5533061 Nov 24 15:57:48.265288 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device d987a73b-9a85-4daa-837f-bdd643cc478c up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 15:57:48.362010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port d987a73b-9a85-4daa-837f-bdd643cc478c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:48.362415 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:48.410661 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af7b6be1-6a39-4c93-a3fa-befe389930cf None None] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 15:57:48.525499 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:48.605572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port d987a73b-9a85-4daa-837f-bdd643cc478c, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=d987a73b-9a85-4daa-837f-bdd643cc478c,segment=NetworkSegment(c1c1fe05-b0a6-43fd-b113-55cd6eb1af14),segment_id=c1c1fe05-b0a6-43fd-b113-55cd6eb1af14)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:57:48.609310 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-86207511-1e64-4437-b721-801e91d6a64c None None] Provisioning complete for port d987a73b-9a85-4daa-837f-bdd643cc478c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:48.609663 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-86207511-1e64-4437-b721-801e91d6a64c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:48.618543 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:48.680431 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-417a6d34-12a2-4889-90c1-fec734276c9d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:48.736725 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=d987a73b-9a85-4daa-837f-bdd643cc478c,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:49.033211 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-1edb90cb-105f-4c94-9934-9f640632ceb7 None None] Provisioning complete for port d987a73b-9a85-4daa-837f-bdd643cc478c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:49.033587 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-1edb90cb-105f-4c94-9934-9f640632ceb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:50.015023 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57176) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:50.221250 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device d987a73b-9a85-4daa-837f-bdd643cc478c up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 15:57:50.271742 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port d987a73b-9a85-4daa-837f-bdd643cc478c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:50.272116 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:50.358582 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [None req-270e0f12-445f-49cb-9667-a9237068d0d5 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 15:57:50.359554 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-270e0f12-445f-49cb-9667-a9237068d0d5 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3436358 Nov 24 15:57:51.213347 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ef406a36-b183-4056-b870-e3225b8d5fc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:52.569563 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:52.942838 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57194) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:53.077496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Request body: {'network': {'router:external': True, 'provider:physical_network': 'physnet1', 'is_default': True, 'name': 'public', 'admin_state_up': True, 'provider:network_type': 'flat'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:57:53.079227 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.quota [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Loaded quota_driver: . Nov 24 15:57:53.136008 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Made reservation on behalf of d81a2d3885bd43808f8845d65cc5b0ad for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:57:53.205517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.policy [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102788) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 15:57:53.254817 dv-cinder-818994-2-iscsi neutron-server[102788]: WARNING oslo_policy.policy [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:53.255189 dv-cinder-818994-2-iscsi neutron-server[102788]: WARNING oslo_policy.policy [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 15:57:53.264995 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.285208 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.400297 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.404548 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.418673 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Reserving flat network on physical network physnet1 {{(pid=102788) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 24 15:57:53.456984 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8794868623791', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.457515 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Unsubscribe: segment precommit_create {{(pid=102788) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 15:57:53.458782 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Added segment 8cf6f0fa-902a-4107-903f-7e946fa3729f of type flat for network b30ec751-e8b3-4e51-a19c-98cbd4d210ff Nov 24 15:57:53.467327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f29ff2ab-2202-4842-9a1d-b696511eb08c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:53.494286 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.494695 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.495031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.495362 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.495692 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.496031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.496355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.496690 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.497052 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.497367 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.497685 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.498000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Tracked resource versions report: Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: pushed versions: Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: { 'AddressGroup': {'1.2'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'ConntrackHelper': {'1.0'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Log': {'1.0'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Network': {'1.1'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Port': {'1.7'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'PortForwarding': {'1.2'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'QosPolicy': {'1.10'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroup': {'1.5'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroupRule': {'1.2'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SubPort': {'1.0'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Subnet': {'1.1'}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Trunk': {'1.1'}} Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: consumer versions: Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'ConntrackHelper': '1.0', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Log': '1.0', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Network': '1.1', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Port': '1.7', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'PortForwarding': '1.2', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'QosPolicy': '1.10', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroup': '1.5', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroupRule': '1.2', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SubPort': '1.0', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Subnet': '1.1', Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Trunk': '1.1'}} Nov 24 15:57:53.499292 dv-cinder-818994-2-iscsi neutron-server[102788]: {{(pid=102788) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 15:57:53.599946 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.648323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.649513 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:57:53.650252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:53.712845 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7690470 Nov 24 15:57:53.761784 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7af7e9-89c5-4a0a-bab7-cfff2fc2ffa8 admin admin] Pushing event updated for resources: {'Network': ['ID=b30ec751-e8b3-4e51-a19c-98cbd4d210ff,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:53.773766 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 15:57:53.992086 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 15:57:54.292291 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:54.421511 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:56.106989 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57218) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:57:56.243537 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d10b7bf8-8a8e-4fbf-a66e-2d3a509c86f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:57:56.244904 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d10b7bf8-8a8e-4fbf-a66e-2d3a509c86f4 admin admin] 10.222.0.72 "GET /v2.0/subnets/f751dd20-97f3-48d2-914c-f6c1a88ce24f HTTP/1.1" status: 200 len: 849 time: 0.1369646 Nov 24 15:57:56.403900 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-19cdbe7b-745a-45a7-8044-f7989dd4c2ff admin admin] 10.222.0.72 "GET /v2.0/routers/f7de37f3-43ba-4e0d-831f-c0f3a206ab7e HTTP/1.1" status: 200 len: 704 time: 0.1526120 Nov 24 15:57:56.690338 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.002933 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Allocated IP 172.20.0.1 (4bc2fa4b-98af-42f7-899c-bc24223d2927/f751dd20-97f3-48d2-914c-f6c1a88ce24f/556fc602-64f1-46c3-bd38-14b96c674d15) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:57:57.193327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.265589 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.339237 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:57:57.347187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:57:57.361158 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:57:57.361729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.388353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Pushing event updated for resources: {'Port': ['ID=556fc602-64f1-46c3-bd38-14b96c674d15,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:57.566039 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.591440 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-00cd3ee7-fee4-463c-9788-60076ac92d98 None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:57.592047 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-00cd3ee7-fee4-463c-9788-60076ac92d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.624881 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-00cd3ee7-fee4-463c-9788-60076ac92d98 None None] Port 556fc602-64f1-46c3-bd38-14b96c674d15 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 15:57:57.837102 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.841805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.843557 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:57.903046 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Pushing event updated for resources: {'Port': ['ID=556fc602-64f1-46c3-bd38-14b96c674d15,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:57.972155 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:57:57.974179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:57:58.148487 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-edc71e16-c79e-4003-a164-72c4a3ddf98a None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:58.149067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-edc71e16-c79e-4003-a164-72c4a3ddf98a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:58.157842 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:57:58.189963 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-edc71e16-c79e-4003-a164-72c4a3ddf98a None None] Port 556fc602-64f1-46c3-bd38-14b96c674d15 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 15:57:58.255862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:57:58.261222 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-cb6288ea-b018-493f-b7db-9974d42a637f admin admin] 10.222.0.72 "PUT /v2.0/routers/f7de37f3-43ba-4e0d-831f-c0f3a206ab7e/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.8517437 Nov 24 15:57:58.276750 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Sync routers for ids ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 15:57:58.290146 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Routers {'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:57:58.291107 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T15:57:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:58.482610 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Set router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 15:57:58.945508 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:57:57Z', 'revision_number': 2, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port_host': None, '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:57:57Z', 'revision_number': 2, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:58.999830 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Checking router: f7de37f3-43ba-4e0d-831f-c0f3a206ab7e for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 15:57:59.000207 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Updating router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e port 556fc602-64f1-46c3-bd38-14b96c674d15 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 15:57:59.053263 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.584711 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.590580 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.753146 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Pushing event updated for resources: {'Port': ['ID=556fc602-64f1-46c3-bd38-14b96c674d15,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:57:59.768466 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Attempting to bind port 556fc602-64f1-46c3-bd38-14b96c674d15 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 15:57:59.768466 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Attempting to bind port 556fc602-64f1-46c3-bd38-14b96c674d15 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 15:57:59.768820 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Attempting to bind port 556fc602-64f1-46c3-bd38-14b96c674d15 on network 4bc2fa4b-98af-42f7-899c-bc24223d2927 {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 15:57:59.772162 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.772521 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.772872 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.773238 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.773580 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.773921 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.774257 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.774595 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.774933 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.775266 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.775596 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.775920 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Tracked resource versions report: Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: pushed versions: Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: { 'AddressGroup': {'1.2'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'ConntrackHelper': {'1.0'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Log': {'1.0'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Network': {'1.1'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Port': {'1.7'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'PortForwarding': {'1.2'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'QosPolicy': {'1.10'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroup': {'1.5'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroupRule': {'1.2'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SubPort': {'1.0'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Subnet': {'1.1'}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Trunk': {'1.1'}} Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: consumer versions: Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'ConntrackHelper': '1.0', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Log': '1.0', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Network': '1.1', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Port': '1.7', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'PortForwarding': '1.2', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'QosPolicy': '1.10', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroup': '1.5', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroupRule': '1.2', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SubPort': '1.0', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Subnet': '1.1', Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Trunk': '1.1'}} Nov 24 15:57:59.776974 dv-cinder-818994-2-iscsi neutron-server[102790]: {{(pid=102790) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 15:57:59.783691 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 57, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 15:57:59.784155 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Checking segment: {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 15:57:59.784587 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.784968 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Bound using segment: {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 15:57:59.785514 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Bound port: 556fc602-64f1-46c3-bd38-14b96c674d15, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1c1fe05-b0a6-43fd-b113-55cd6eb1af14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1000, 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 15:57:59.785912 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.821317 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-c1e628ce-7be7-4108-9bdd-a4cf00fcc3fe None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:57:59.822322 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c1e628ce-7be7-4108-9bdd-a4cf00fcc3fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.858617 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-c1e628ce-7be7-4108-9bdd-a4cf00fcc3fe None None] Port 556fc602-64f1-46c3-bd38-14b96c674d15 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 15:57:59.863003 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] For port 556fc602-64f1-46c3-bd38-14b96c674d15, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:57:59.885221 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] For port 556fc602-64f1-46c3-bd38-14b96c674d15, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=556fc602-64f1-46c3-bd38-14b96c674d15,segment=NetworkSegment(c1c1fe05-b0a6-43fd-b113-55cd6eb1af14),segment_id=c1c1fe05-b0a6-43fd-b113-55cd6eb1af14)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:57:59.891476 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:57:59.956492 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Routers {'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:57:59.957152 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T15:57:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:57:59.960075 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129aa9ad-ca0c-4edd-815d-c0abada4189d None None] Pushing event updated for resources: {'Port': ['ID=556fc602-64f1-46c3-bd38-14b96c674d15,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:00.053684 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] Set router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 15:58:00.183916 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:58:00.184289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:00.271022 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:00.299463 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:57:57Z', 'revision_number': 2, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port_host': None, '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:57:59Z', 'revision_number': 4, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:58:00.309395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] For port 556fc602-64f1-46c3-bd38-14b96c674d15, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=556fc602-64f1-46c3-bd38-14b96c674d15,segment=NetworkSegment(c1c1fe05-b0a6-43fd-b113-55cd6eb1af14),segment_id=c1c1fe05-b0a6-43fd-b113-55cd6eb1af14)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:58:00.314803 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:00.328118 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e362695-8c18-4e61-9561-096f38d9ca72 None None] The sync data for ids ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'] in dv-cinder-818994-2-iscsi is: [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:57:57Z', 'revision_number': 2, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port_host': None, '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:57:59Z', 'revision_number': 4, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 15:58:00.375007 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee77a44e-72bf-4ddc-a6f0-ff380b61e26b None None] Pushing event updated for resources: {'Port': ['ID=556fc602-64f1-46c3-bd38-14b96c674d15,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:00.665042 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57228) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:58:00.789914 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-446c5f80-7533-481b-a399-94f9ded89fbb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:58:00.791345 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-446c5f80-7533-481b-a399-94f9ded89fbb admin admin] 10.222.0.72 "GET /v2.0/networks/b30ec751-e8b3-4e51-a19c-98cbd4d210ff HTTP/1.1" status: 200 len: 842 time: 0.1253183 Nov 24 15:58:00.802086 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Request body: {'subnet': {'enable_dhcp': False, 'name': 'public-subnet', 'gateway_ip': '172.27.0.1', 'ip_version': 4, 'cidr': '172.27.0.0/24', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:58:00.824234 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Made reservation on behalf of d81a2d3885bd43808f8845d65cc5b0ad for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:58:00.826790 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:01.145504 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.objects.ports [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102787) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 15:58:01.145960 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:01.200564 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Pushing event updated for resources: {'Subnet': ['ID=824670b0-d537-4fe9-a92d-99c6238378a4,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:01.210441 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 15:58:01.210802 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Network hostable DHCP agents. Network: b30ec751-e8b3-4e51-a19c-98cbd4d210ff, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:58:01.228922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:58:01.238101 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, b30ec751-e8b3-4e51-a19c-98cbd4d210ff) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:58:01.243357 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:58:01.243992 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:01.249362 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b389b19c-9413-4410-a016-91c53f4df63f None None] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 15:58:01.268784 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-88f91cdb-3601-495a-8491-23aa52d8c99e admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4622495 Nov 24 15:58:01.404321 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f9616f3-6f0d-4b3f-87d5-857289f920c5 None None] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 15:58:03.736216 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57236) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:58:03.959625 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-62bc0710-54f2-47ef-afda-1489b66307ac admin admin] 10.222.0.72 "GET /v2.0/routers/f7de37f3-43ba-4e0d-831f-c0f3a206ab7e HTTP/1.1" status: 200 len: 710 time: 0.2219768 Nov 24 15:58:04.061896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b11127f7-a3c7-4128-92bb-2cb790b66424 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:58:04.063326 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b11127f7-a3c7-4128-92bb-2cb790b66424 admin admin] 10.222.0.72 "GET /v2.0/networks/b30ec751-e8b3-4e51-a19c-98cbd4d210ff HTTP/1.1" status: 200 len: 886 time: 0.0976827 Nov 24 15:58:04.073781 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:58:04.384097 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:04.623204 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:04.698553 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:04.856829 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Allocated IP 172.27.0.21 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/1e0ee478-19bc-4ec9-afcf-d972dcc667d9) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:58:04.971282 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.031972 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.107554 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:58:05.116768 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:58:05.121558 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:58:05.124702 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Pushing event updated for resources: {'Port': ['ID=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:05.403051 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.601506 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-33291697', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-33090528', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2046'] for router, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.606096 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-33276053', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-33287990', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-33090514'] for router, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.790559 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:58:05.904643 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:58:05.909226 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:05.924818 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-60631aba-a618-4acb-9bdf-047b6297df6d admin admin] 10.222.0.72 "PUT /v2.0/routers/f7de37f3-43ba-4e0d-831f-c0f3a206ab7e HTTP/1.1" status: 200 len: 889 time: 1.8402696 Nov 24 15:58:06.263429 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 556fc602-64f1-46c3-bd38-14b96c674d15 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 15:58:06.316322 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:58:06.316832 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:07.433918 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Sync routers for ids ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 15:58:07.446874 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Routers {'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:58:07.448596 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T15:57:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:58:07.670408 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Set router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 15:58:08.146381 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:58:05Z', 'revision_number': 4, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port': {'id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:24:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:58:04Z', 'updated_at': '2021-11-24T15:58:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:58:00Z', 'revision_number': 5, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:58:08.200788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Checking router: f7de37f3-43ba-4e0d-831f-c0f3a206ab7e for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 15:58:08.201224 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Updating router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 15:58:08.257281 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.527033 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57248) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:58:08.593013 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.602706 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.654996 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Attempting to bind port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 15:58:08.655366 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Attempting to bind port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 15:58:08.655752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Attempting to bind port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 15:58:08.657931 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-45ee8723-c3b2-4642-aeae-a710bd511a37 admin admin] 10.222.0.72 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1298001 Nov 24 15:58:08.667187 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 57, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 15:58:08.667567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 15:58:08.667995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.668368 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 15:58:08.668851 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Bound port: 1e0ee478-19bc-4ec9-afcf-d972dcc667d9, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 15:58:08.669287 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.672437 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c296dc-904e-4dd6-8ad9-e34a7f04544c None None] Pushing event updated for resources: {'Port': ['ID=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:08.727349 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] For port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:58:08.730994 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] For port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:58:08.735532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:08.818903 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Routers {'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:58:08.819965 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T15:57:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:58:08.829364 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c296dc-904e-4dd6-8ad9-e34a7f04544c None None] Pushing event updated for resources: {'Port': ['ID=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:08.953228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] Set router f7de37f3-43ba-4e0d-831f-c0f3a206ab7e gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 15:58:09.218987 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:58:05Z', 'revision_number': 4, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port': {'id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:24:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:58:04Z', 'updated_at': '2021-11-24T15:58:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:58:00Z', 'revision_number': 5, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:58:09.247010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a084683d-df89-45d8-8e77-63bbcd42c710 None None] The sync data for ids ['f7de37f3-43ba-4e0d-831f-c0f3a206ab7e'] in dv-cinder-818994-2-iscsi is: [{'id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'name': 'router1', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:57:47Z', 'updated_at': '2021-11-24T15:58:05Z', 'revision_number': 4, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'gw_port': {'id': '1e0ee478-19bc-4ec9-afcf-d972dcc667d9', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:24:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:58:04Z', 'updated_at': '2021-11-24T15:58:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '556fc602-64f1-46c3-bd38-14b96c674d15', 'name': '', 'network_id': '4bc2fa4b-98af-42f7-899c-bc24223d2927', 'tenant_id': '15e538041c6b40d79499409143e5b7e5', 'mac_address': 'fa:16:3e:a9:47:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7de37f3-43ba-4e0d-831f-c0f3a206ab7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:57:56Z', 'updated_at': '2021-11-24T15:58:00Z', 'revision_number': 5, 'project_id': '15e538041c6b40d79499409143e5b7e5', 'subnets': [{'id': 'f751dd20-97f3-48d2-914c-f6c1a88ce24f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '3c8aefdb-b7e0-4818-a28c-3efd8ac1d5bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 15:58:10.272597 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 15:58:10.320708 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:58:10.321109 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:10.401755 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:10.427334 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:58:10.431825 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:10.483845 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=1e0ee478-19bc-4ec9-afcf-d972dcc667d9,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:58:12.260029 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 15:58:12.317943 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 1e0ee478-19bc-4ec9-afcf-d972dcc667d9 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:58:12.318617 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:18.614119 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-118edb87-50bb-4823-9d55-6741638503f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:21.216767 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-914ef769-4dce-425c-9eca-e2c63ca82064 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:22.588403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:24.289452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:24.385678 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:30.992055 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 15:58:48.586146 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bfd40189-77b7-4276-ad5e-91a588ae4d5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:51.227563 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3b8976fd-795e-463e-b605-28e46d8cef9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:52.586552 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:54.288113 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:58:54.385585 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:07.995252 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 15:59:18.578936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-56eb040b-85d0-4b5c-8dab-dbe174e36034 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:21.219364 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8da7ff0f-3e1b-4728-a23a-e5433df9504b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:22.575920 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:24.281286 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:24.382993 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:30.720520 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57732) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:30.790069 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.pecan_wsgi.hooks.translation [None req-497b4205-2785-4fc6-944f-7d719cd9496a admin admin] GET failed (client error): The resource could not be found. Nov 24 15:59:30.791365 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-497b4205-2785-4fc6-944f-7d719cd9496a admin admin] 10.222.0.72 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0698366 Nov 24 15:59:30.954666 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6af44db5-59ce-4f5d-8ec4-1b17c0a40a72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:30.956341 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6af44db5-59ce-4f5d-8ec4-1b17c0a40a72 admin admin] 10.222.0.72 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1603022 Nov 24 15:59:33.267783 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57742) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:33.361299 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d7653c6-0826-4b14-95c3-f787142bdb5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:33.362783 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-0d7653c6-0826-4b14-95c3-f787142bdb5a admin admin] 10.222.0.72 "GET /v2.0/subnets/f751dd20-97f3-48d2-914c-f6c1a88ce24f HTTP/1.1" status: 200 len: 849 time: 0.0939906 Nov 24 15:59:33.372786 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 15:59:33.462796 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:33.604995 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8794868611449'] for subnet, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:33.638893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:33.639275 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:33.640569 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] 10.222.0.72 "PUT /v2.0/subnets/f751dd20-97f3-48d2-914c-f6c1a88ce24f HTTP/1.1" status: 200 len: 868 time: 0.2715650 Nov 24 15:59:33.642006 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c922fece-b449-4418-a384-c3c9cfd1548e None None] Network 4bc2fa4b-98af-42f7-899c-bc24223d2927 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 15:59:33.664313 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f751dd20-97f3-48d2-914c-f6c1a88ce24f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:59:33.672367 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.672751 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.673132 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.673484 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.673824 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.674202 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.674549 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.675058 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.675420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.675757 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.676088 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:33.676444 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aae9cdd-660b-4c90-b456-5913cada24f8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:59:34.063369 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-5e012f9a-1746-4bac-9bd3-236df97ea53c None None] Provisioning complete for port d987a73b-9a85-4daa-837f-bdd643cc478c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:59:34.063742 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5e012f9a-1746-4bac-9bd3-236df97ea53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:34.158588 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-5e012f9a-1746-4bac-9bd3-236df97ea53c None None] Provisioning complete for port 556fc602-64f1-46c3-bd38-14b96c674d15 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:59:34.159035 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5e012f9a-1746-4bac-9bd3-236df97ea53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:36.000816 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57750) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:36.204990 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a49d7d-b163-49ac-af94-b8eeed8cf44a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:36.205463 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a49d7d-b163-49ac-af94-b8eeed8cf44a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:36.207584 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-56a49d7d-b163-49ac-af94-b8eeed8cf44a admin admin] 10.222.0.72 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2057683 Nov 24 15:59:38.555065 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57758) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:38.759932 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcdea911-727c-4499-8e3e-f5295dee06e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:38.760319 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcdea911-727c-4499-8e3e-f5295dee06e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:38.761905 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-bcdea911-727c-4499-8e3e-f5295dee06e0 admin admin] 10.222.0.72 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2058926 Nov 24 15:59:41.087932 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57768) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:41.218748 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2a0455e-f294-47f7-8da1-b22fbe0779c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:41.220173 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c2a0455e-f294-47f7-8da1-b22fbe0779c5 admin admin] 10.222.0.72 "GET /v2.0/networks/4bc2fa4b-98af-42f7-899c-bc24223d2927 HTTP/1.1" status: 200 len: 870 time: 0.1312962 Nov 24 15:59:43.542344 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57776) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:43.670225 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27a15b19-7106-4107-bb64-b6420fc9ec05 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:43.671596 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-27a15b19-7106-4107-bb64-b6420fc9ec05 admin admin] 10.222.0.72 "GET /v2.0/networks/b30ec751-e8b3-4e51-a19c-98cbd4d210ff HTTP/1.1" status: 200 len: 886 time: 0.1282985 Nov 24 15:59:44.996399 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 15:59:46.029379 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57784) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:46.156187 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e8439c9-433f-4888-9c82-95e7ec610abf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:46.156637 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e8439c9-433f-4888-9c82-95e7ec610abf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:46.158192 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5e8439c9-433f-4888-9c82-95e7ec610abf admin admin] 10.222.0.72 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1278789 Nov 24 15:59:48.509081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57792) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:48.583456 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-cac40ad5-4078-46c0-afc3-f791a44a40c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:48.603053 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ca548e-78ab-42f2-bb1d-a018ddea7a59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:48.603496 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ca548e-78ab-42f2-bb1d-a018ddea7a59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:48.605083 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-42ca548e-78ab-42f2-bb1d-a018ddea7a59 admin admin] 10.222.0.72 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0950327 Nov 24 15:59:50.927755 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57800) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:51.018619 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef608e5b-d366-4df5-a0ff-56009acbb35d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:51.019986 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ef608e5b-d366-4df5-a0ff-56009acbb35d admin admin] 10.222.0.72 "GET /v2.0/subnets/824670b0-d537-4fe9-a92d-99c6238378a4 HTTP/1.1" status: 200 len: 816 time: 0.0912898 Nov 24 15:59:51.223954 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c6e60b9d-27e4-4b6d-afe2-0f83eb30057c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:52.578079 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:53.355410 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57808) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 15:59:53.451492 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cd8efa9-a055-4edd-a876-4fdc97595690 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:59:53.452901 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7cd8efa9-a055-4edd-a876-4fdc97595690 admin admin] 10.222.0.72 "GET /v2.0/subnets/f751dd20-97f3-48d2-914c-f6c1a88ce24f HTTP/1.1" status: 200 len: 868 time: 0.0964193 Nov 24 15:59:54.290804 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 15:59:54.386449 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:18.235243 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57862) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:00:18.284959 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [None req-15832510-c982-4e34-9faa-56a0c5768ee6 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:00:18.286006 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-15832510-c982-4e34-9faa-56a0c5768ee6 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0498004 Nov 24 16:00:18.587056 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b3fde02f-3c4f-4087-b307-6a9671d6743e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:20.712658 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57870) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:00:20.777361 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.pecan_wsgi.hooks.translation [None req-528f33f1-f6ce-4583-82fa-acf644677edd admin admin] GET failed (client error): The resource could not be found. Nov 24 16:00:20.778688 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-528f33f1-f6ce-4583-82fa-acf644677edd admin admin] 10.222.0.72 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0647838 Nov 24 16:00:20.871314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fd5a837-413a-4447-858e-15662a0fcbf4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:00:20.872710 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4fd5a837-413a-4447-858e-15662a0fcbf4 admin admin] 10.222.0.72 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0889874 Nov 24 16:00:21.228638 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3ee7aa55-da52-4677-b7a6-7eae5a651e60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:21.995106 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:00:22.581717 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.252452 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57878) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:00:23.300722 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:00:23.323078 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Made reservation on behalf of d81a2d3885bd43808f8845d65cc5b0ad for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:00:23.325429 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.360434 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING neutron.services.revisions.revision_plugin [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Could not find related network for resource to bump revision. Nov 24 16:00:23.373861 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1030} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:00:23.384252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.384596 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Added segment 57dddaa3-fafd-4ae7-8b73-837589e44fd5 of type vlan for network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 Nov 24 16:00:23.433910 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.458646 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.459588 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:00:23.460197 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:23.496095 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.2425203 Nov 24 16:00:23.527212 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ee230d-f753-44ea-ab69-a239aa3b01b3 admin admin] Pushing event updated for resources: {'Network': ['ID=5fbcb32b-e15a-4ebf-b876-b0b96814fc90,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:00:23.538930 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:00:24.379744 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:24.389006 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:26.062227 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57886) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:00:26.122883 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d278ce8-82fb-4499-8976-f9a6fa38ba51 admin admin] GET failed (client error): The resource could not be found. Nov 24 16:00:26.124214 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3d278ce8-82fb-4499-8976-f9a6fa38ba51 admin admin] 10.222.0.72 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0610313 Nov 24 16:00:26.195569 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a48976f-3ca7-4c2c-b8a7-a373610a3a1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:00:26.197047 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3a48976f-3ca7-4c2c-b8a7-a373610a3a1f admin admin] 10.222.0.72 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.0672297 Nov 24 16:00:26.207210 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'shared-subnet', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:00:26.227177 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Made reservation on behalf of d81a2d3885bd43808f8845d65cc5b0ad for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:00:26.229443 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:26.483030 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:26.542122 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9180217c-0963-48ea-b509-33d79eecb7f8,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:00:26.551569 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Checking segment: {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:00:26.552137 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Network hostable DHCP agents. Network: 5fbcb32b-e15a-4ebf-b876-b0b96814fc90, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:00:26.568927 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:00:26.577498 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 5fbcb32b-e15a-4ebf-b876-b0b96814fc90) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:00:26.581885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:00:26.582515 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:26.587654 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6e339a2-b70f-423b-8fd1-8555b0604161 None None] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:00:26.599446 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-16fd7e60-e025-4396-8a23-0e4f34401241 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3956223 Nov 24 16:00:26.744159 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-5fbcb32b-e15a-4ebf-b876-b0b96814fc90', 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90', 'tenant_id': 'd81a2d3885bd43808f8845d65cc5b0ad', 'fixed_ips': [{'subnet_id': '9180217c-0963-48ea-b509-33d79eecb7f8'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:00:26.745139 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:26.891757 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Allocated IP 192.168.233.2 (5fbcb32b-e15a-4ebf-b876-b0b96814fc90/9180217c-0963-48ea-b509-33d79eecb7f8/4152b60d-8096-48b2-9960-928ebde81045) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:00:27.035356 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:27.041394 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:27.088982 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:00:27.091760 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:00:27.094339 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:00:27.104072 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Pushing event updated for resources: {'Port': ['ID=4152b60d-8096-48b2-9960-928ebde81045,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:00:27.124199 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.124558 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.124904 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.125253 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.125581 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.125914 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.126501 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.127516 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.127925 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.128243 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.128568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.128886 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:00:27.164269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Attempting to bind port 4152b60d-8096-48b2-9960-928ebde81045 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:00:27.164563 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Attempting to bind port 4152b60d-8096-48b2-9960-928ebde81045 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:00:27.164927 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Attempting to bind port 4152b60d-8096-48b2-9960-928ebde81045 on network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:00:27.170234 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:00:27.170609 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Checking segment: {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:00:27.171025 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:27.171422 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Bound using segment: {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:00:27.171879 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Bound port: 4152b60d-8096-48b2-9960-928ebde81045, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:00:27.172299 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:27.250378 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] For port 4152b60d-8096-48b2-9960-928ebde81045, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:00:27.254959 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] For port 4152b60d-8096-48b2-9960-928ebde81045, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4152b60d-8096-48b2-9960-928ebde81045,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:00:27.259656 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:27.336117 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a94ea06-ee31-4476-b733-5e549cd9a74d None None] Pushing event updated for resources: {'Port': ['ID=4152b60d-8096-48b2-9960-928ebde81045,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:00:28.151847 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41839156-936f-4230-9804-5ebc840f816f None None] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:00:28.238473 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] Provisioning complete for port 4152b60d-8096-48b2-9960-928ebde81045 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:00:28.238761 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:28.390905 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:28.403728 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4152b60d-8096-48b2-9960-928ebde81045 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:00:28.475341 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] For port 4152b60d-8096-48b2-9960-928ebde81045, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4152b60d-8096-48b2-9960-928ebde81045,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:00:28.480601 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:28.515427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 4152b60d-8096-48b2-9960-928ebde81045 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:00:28.515813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:28.569145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c81952-2dbc-4714-b5c2-86356b1cb8c1 None None] Pushing event updated for resources: {'Port': ['ID=4152b60d-8096-48b2-9960-928ebde81045,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:00:28.702410 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-a8eb0c0e-4be8-4a4f-92a5-e1fd39fd2bc8 None None] Provisioning complete for port 4152b60d-8096-48b2-9960-928ebde81045 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:00:28.702774 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a8eb0c0e-4be8-4a4f-92a5-e1fd39fd2bc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:30.344836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4152b60d-8096-48b2-9960-928ebde81045 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:00:30.392299 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 4152b60d-8096-48b2-9960-928ebde81045 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:00:30.392681 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:48.589474 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f44c335c-2eb4-410f-81c6-c0bfa315778c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:51.231318 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ea834b79-f341-472e-bd55-d830ef04f01e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:52.584567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:54.282453 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:54.391227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:00:58.993305 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:01:18.591450 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-43c41b51-f2ef-4270-a8b1-0227a7a4ca22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:21.235736 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3a2c2255-4654-4f54-a46a-e0772bc269e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:22.587554 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:24.285260 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:24.394588 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:35.992390 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:01:39.680408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57930) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:01:39.686414 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [None req-ec8247dc-950d-4484-91d8-2cfd21f23cea tempest-verify_tempest_config-1450488059 tempest-verify_tempest_config-1450488059-project] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:01:39.687978 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ec8247dc-950d-4484-91d8-2cfd21f23cea tempest-verify_tempest_config-1450488059 tempest-verify_tempest_config-1450488059-project] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0065663 Nov 24 16:01:39.985085 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 57948) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:01:40.088779 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.161700 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.165330 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.211468 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=4b596fad90374b05aace9ca2a51ac0d3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2253025 Nov 24 16:01:40.212294 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85c81857-e5be-471c-9840-c871bdb2bd7c,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:01:40.214147 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 57952) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:01:40.219980 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.220337 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.220717 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.221082 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.221561 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.221911 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.222251 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.222586 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.222938 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.223273 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.223602 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.223929 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b9aa52-555c-4e83-bfa4-50f24f216a8d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.269714 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.289469 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.379025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.381605 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:40.382751 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/85c81857-e5be-471c-9840-c871bdb2bd7c HTTP/1.1" status: 204 len: 168 time: 0.1675243 Nov 24 16:01:40.390605 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85c81857-e5be-471c-9840-c871bdb2bd7c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:01:40.397382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.397753 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.398101 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.398440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.398771 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.399118 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.399452 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.399778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.400115 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.400443 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.400766 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:40.401121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e0b998e-04ce-4c6f-a990-014ed41a6025 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:01:48.594257 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-861ce24e-8ff3-4bf2-bc2b-048c815420d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:51.237128 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d66d132d-4044-495d-b08b-de6fa108a3d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:52.592901 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:54.287297 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:01:54.396685 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:12.992572 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:02:18.597559 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-80c9bf02-1bf7-47c1-bc7d-81884bca141e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:21.239972 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2faa92e-f087-4253-9a4a-df27a39f87d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:22.593884 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:24.289295 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:24.399564 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:48.598217 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-898e29ac-f771-4421-bb44-fc360303fb6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:49.991457 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 5 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:02:51.240649 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-1c610106-75f6-4900-985c-deeb8590d581 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:52.598090 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:54.290577 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:02:54.402516 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:13.805626 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33089746'] for agent, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:18.601299 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ad514df5-7088-4f35-9113-ab8857a4f8ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:21.245532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ebed7d36-d5f9-4a2d-af6f-727bcc9c3c8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:22.601137 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:24.294763 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:24.405820 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:26.992246 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:03:28.811215 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58026) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:03:28.933869 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0bfdd204-30e7-493e-8207-d72a262642f7 admin admin] 10.222.0.72 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1215222 Nov 24 16:03:31.321781 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58036) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:03:31.377370 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c26bbc23-ba84-4f1b-893c-72a707e3f881 admin admin] 10.222.0.72 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0544844 Nov 24 16:03:43.758708 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:48.604799 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-793e03d9-fbf1-4bf7-b204-5ca8a59232d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:51.252002 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-31abfd7e-0ecf-403b-9346-a7344d32e29c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:52.604952 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:54.299136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:03:54.416977 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:03.996450 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:04:13.779799 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:18.620545 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9022b4e5-e2f0-454f-a093-f8462e16e086 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:21.255533 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2c731785-3d91-416a-9cc8-c3fbcb329ed5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:22.615384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:24.324465 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:24.446786 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:40.996652 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:04:43.773792 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:48.613636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8854949a-84cf-422b-aff1-6bed40c1f91c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:51.253214 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4a4f11cb-cfda-4e01-8f64-4ea084678b8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:52.604164 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:54.304494 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:04:54.428382 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:03.494954 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58134) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:03.842666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-564369334-network', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:03.871988 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Made reservation on behalf of 4ca913475fb04e7a8ea75d95578c8b84 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:03.876082 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:03.890685 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.023846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.029948 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.072549 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1047} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:05:04.102212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d88dd602-022a-482c-8611-ddb6fa63acd4,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:04.117421 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.118053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.118849 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.119440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.120019 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.120613 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.121262 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.121857 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.122463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.123061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.123616 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.124210 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Tracked resource versions report: Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: pushed versions: Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: { 'AddressGroup': {'1.2'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'ConntrackHelper': {'1.0'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Log': {'1.0'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Network': {'1.1'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Port': {'1.7'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'PortForwarding': {'1.2'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'QosPolicy': {'1.10'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroup': {'1.5'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SubPort': {'1.0'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Subnet': {'1.1'}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Trunk': {'1.1'}} Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: consumer versions: Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: HyperV agent@hv-cinder-81899: {}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'ConntrackHelper': '1.0', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Log': '1.0', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Network': '1.1', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Port': '1.7', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'PortForwarding': '1.2', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'QosPolicy': '1.10', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroup': '1.5', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SecurityGroupRule': '1.2', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'SubPort': '1.0', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Subnet': '1.1', Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: 'Trunk': '1.1'}} Nov 24 16:05:04.126868 dv-cinder-818994-2-iscsi neutron-server[102788]: {{(pid=102788) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:05:04.141174 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.141174 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Added segment 4ba13f07-5206-4f2b-9083-f91096492150 of type vlan for network 282e5dca-255c-487d-a4fd-a70d7293f6b8 Nov 24 16:05:04.201255 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.246588 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.247546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:04.248166 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.278569 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.7813385 Nov 24 16:05:04.283881 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58180) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:04.293288 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Request body: {'subnet': {'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-subnet', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:04.330566 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47afa4d-a990-476a-963d-d3f5716807cf admin admin] Pushing event updated for resources: {'Network': ['ID=282e5dca-255c-487d-a4fd-a70d7293f6b8,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:04.332817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Made reservation on behalf of 4ca913475fb04e7a8ea75d95578c8b84 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:04.338351 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.343520 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:05:04.616440 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.675284 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Pushing event updated for resources: {'Subnet': ['ID=2243cd13-32e0-4ca8-9d04-3e463c6c8988,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:04.698252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.698612 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.698958 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.699298 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.699657 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.699977 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.700309 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.700651 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.701002 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.701397 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.701750 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.702184 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Tracked resource versions report: Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: pushed versions: Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: { 'AddressGroup': {'1.2'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'ConntrackHelper': {'1.0'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Log': {'1.0'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Network': {'1.1'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Port': {'1.7'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'PortForwarding': {'1.2'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'QosPolicy': {'1.10'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroup': {'1.5'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SubPort': {'1.0'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Subnet': {'1.1'}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Trunk': {'1.1'}} Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: consumer versions: Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: HyperV agent@hv-cinder-81899: {}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'ConntrackHelper': '1.0', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Log': '1.0', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Network': '1.1', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Port': '1.7', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'PortForwarding': '1.2', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'QosPolicy': '1.10', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroup': '1.5', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SecurityGroupRule': '1.2', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'SubPort': '1.0', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Subnet': '1.1', Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: 'Trunk': '1.1'}} Nov 24 16:05:04.704537 dv-cinder-818994-2-iscsi neutron-server[102787]: {{(pid=102787) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:05:04.719009 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Checking segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:04.719630 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Network hostable DHCP agents. Network: 282e5dca-255c-487d-a4fd-a70d7293f6b8, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:05:04.764999 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:05:04.783861 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 282e5dca-255c-487d-a4fd-a70d7293f6b8) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:04.794817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:04.795925 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.797943 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7398b041-7d58-4319-9df2-05155f02bfdc None None] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:04.835457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58200) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:04.836212 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-dd6cfb56-b60b-4054-aab3-b72491d841bb admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5506539 Nov 24 16:05:04.841396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:04.874799 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:04.876194 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.017724 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.058335 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-282e5dca-255c-487d-a4fd-a70d7293f6b8', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:05:05.059679 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.186313 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.197703 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58220) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:05.271364 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Allocated IP 172.20.0.2 (282e5dca-255c-487d-a4fd-a70d7293f6b8/2243cd13-32e0-4ca8-9d04-3e463c6c8988/3d045898-91ac-4634-b168-eeaa9c87f097) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:05.456219 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.465579 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.525418 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:05.527608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:05.543242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:05.548835 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Pushing event updated for resources: {'Port': ['ID=3d045898-91ac-4634-b168-eeaa9c87f097,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:05.565656 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.566288 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.567396 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.567741 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.568076 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.568474 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.568730 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.569089 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.569426 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.569923 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.570247 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.570565 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Tracked resource versions report: Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: pushed versions: Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: { 'AddressGroup': {'1.2'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'ConntrackHelper': {'1.0'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Log': {'1.0'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Network': {'1.1'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Port': {'1.7'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'PortForwarding': {'1.2'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'QosPolicy': {'1.10'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroup': {'1.5'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SubPort': {'1.0'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Subnet': {'1.1'}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Trunk': {'1.1'}} Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: consumer versions: Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: HyperV agent@hv-cinder-81899: {}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'ConntrackHelper': '1.0', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Log': '1.0', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Network': '1.1', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Port': '1.7', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'PortForwarding': '1.2', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'QosPolicy': '1.10', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroup': '1.5', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SecurityGroupRule': '1.2', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'SubPort': '1.0', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Subnet': '1.1', Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: 'Trunk': '1.1'}} Nov 24 16:05:05.572075 dv-cinder-818994-2-iscsi neutron-server[102789]: {{(pid=102789) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:05:05.575173 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58238) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:05.598008 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1708063480-network', 'tenant_id': '1c341b845ae6468b847beba4eee796dd'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:05.636506 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Made reservation on behalf of 1c341b845ae6468b847beba4eee796dd for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:05.639068 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.658571 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.685693 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Attempting to bind port 3d045898-91ac-4634-b168-eeaa9c87f097 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:05.688550 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Attempting to bind port 3d045898-91ac-4634-b168-eeaa9c87f097 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:05.690673 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Attempting to bind port 3d045898-91ac-4634-b168-eeaa9c87f097 on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:05.698529 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.702116 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:05.703572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Checking segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:05.704871 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.705646 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Bound using segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:05.706313 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Bound port: 3d045898-91ac-4634-b168-eeaa9c87f097, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:05.707745 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.790006 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.804206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.808776 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.809349 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] For port 3d045898-91ac-4634-b168-eeaa9c87f097, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:05.815230 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] For port 3d045898-91ac-4634-b168-eeaa9c87f097, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=3d045898-91ac-4634-b168-eeaa9c87f097,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:05.822523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.841252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1041} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:05:05.860600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ae5efb3-f95b-42dc-9d0f-ec9291a6fd2f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:05.868887 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:05.869313 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Added segment 74f01bad-61a2-41c6-9cce-ac0e3acebb69 of type vlan for network d785b693-1522-4c61-9c47-37993ec7d517 Nov 24 16:05:05.926640 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b3ace2-0f0d-4a73-9cf1-8d0929b594af None None] Pushing event updated for resources: {'Port': ['ID=3d045898-91ac-4634-b168-eeaa9c87f097,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:05.952147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.014678 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Allocated IP 172.27.0.13 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:06.029902 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.032288 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:06.033831 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.138261 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.9389598 Nov 24 16:05:06.139056 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58252) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:06.139727 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3237251d-fb62-4b57-90a6-dc4192d04e28 admin admin] Pushing event updated for resources: {'Network': ['ID=d785b693-1522-4c61-9c47-37993ec7d517,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:06.147980 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Request body: {'subnet': {'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1708063480-subnet', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:06.158752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network d785b693-1522-4c61-9c47-37993ec7d517 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:05:06.189738 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Made reservation on behalf of 1c341b845ae6468b847beba4eee796dd for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:06.193962 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.295554 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.414613 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-network', 'tenant_id': '60b309e35e734edbaf96c844838de867'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:06.454965 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.468850 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Made reservation on behalf of 60b309e35e734edbaf96c844838de867 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:06.473071 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.507928 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.561599 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:06.565854 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:06.571103 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:06.580992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Pushing event updated for resources: {'Port': ['ID=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:06.735368 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.803676 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Pushing event updated for resources: {'Subnet': ['ID=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:06.860217 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Checking segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:06.860574 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Network hostable DHCP agents. Network: d785b693-1522-4c61-9c47-37993ec7d517, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:05:06.871163 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.872031 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 3d045898-91ac-4634-b168-eeaa9c87f097 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:06.884332 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.892273 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Network d785b693-1522-4c61-9c47-37993ec7d517 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:05:06.911066 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, d785b693-1522-4c61-9c47-37993ec7d517) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:06.929454 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:06.930088 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:06.941538 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1035} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:05:06.958103 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-44bffeed-ef9c-4df7-bbd7-1d40575c454a admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8113775 Nov 24 16:05:06.959108 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58268) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:06.966115 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:06.975765 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9861b010-3b3e-4cb6-b9c5-d9914469bbe7 None None] Network d785b693-1522-4c61-9c47-37993ec7d517 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:07.009373 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58270) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:07.018354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b97e978-496d-4df2-91d4-02aa61537c15,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:07.022031 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.022428 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Added segment 331e4e5c-9bcb-4bdc-b3e6-31289c608ef3 of type vlan for network df42b516-6753-481b-a21c-74d7dd325e73 Nov 24 16:05:07.025153 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.026516 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.062602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.128692 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.221827 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.345481 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 3d045898-91ac-4634-b168-eeaa9c87f097 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:07.345873 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.372712 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.374360 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:07.376059 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.520789 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34b3c606-79f3-4a8a-9f30-db9b5eb13759 None None] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:07.554939 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.555191 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.9762347 Nov 24 16:05:07.555604 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58288) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:07.557776 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab338a9e-483e-4661-aeb2-da4198c56f26 admin admin] Pushing event updated for resources: {'Network': ['ID=df42b516-6753-481b-a21c-74d7dd325e73,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:07.567354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Request body: {'subnet': {'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-subnet', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:07.577195 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network df42b516-6753-481b-a21c-74d7dd325e73 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:05:07.619286 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58290) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:07.739436 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-0746cde9-f783-43f7-9092-02eed3f39dd1 None None] Provisioning complete for port 3d045898-91ac-4634-b168-eeaa9c87f097 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:07.739752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0746cde9-f783-43f7-9092-02eed3f39dd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.759872 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.797360 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-447883267-network', 'tenant_id': 'c127095ad8cc41098ef0dd79f4fcd589'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:07.833884 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Made reservation on behalf of 60b309e35e734edbaf96c844838de867 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:07.838633 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:07.982794 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Made reservation on behalf of c127095ad8cc41098ef0dd79f4fcd589 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:08.001374 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.031377 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Router 4659895c-56b7-4459-9ba6-d88a8c81621f is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:05:08.043432 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.131514 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-d785b693-1522-4c61-9c47-37993ec7d517', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:05:08.133188 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.268573 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.281770 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1491751026-network', 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:08.406895 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:08.411465 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.472841 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.504776 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:08.530215 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.553522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Checking segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:08.554059 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Network hostable DHCP agents. Network: df42b516-6753-481b-a21c-74d7dd325e73, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:05:08.559662 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:08.573179 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:08.602078 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:08.603777 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:08.665566 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.674590 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.678921 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Network df42b516-6753-481b-a21c-74d7dd325e73 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:05:08.725742 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.740191 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c12c4963-860a-4c44-882a-0e5fcd5036e4 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.8897491 Nov 24 16:05:08.745710 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58316) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:08.853290 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88ac201e-ff5b-4f61-b70c-6a022b48d436,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:08.858306 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1036} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:05:08.887138 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0746cde9-f783-43f7-9092-02eed3f39dd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:08.917548 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, df42b516-6753-481b-a21c-74d7dd325e73) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:09.013557 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe0c549e-24ff-4817-8133-4e9465744a15 None None] Network df42b516-6753-481b-a21c-74d7dd325e73 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:09.044956 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.049162 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:09.050956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.054895 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Added segment cfd8620d-0436-44f1-9416-05a3b74c08b2 of type vlan for network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 Nov 24 16:05:09.088967 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 3d045898-91ac-4634-b168-eeaa9c87f097, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=3d045898-91ac-4634-b168-eeaa9c87f097,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:09.120058 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-d7f870a1-039d-4f36-9f75-d1ffb0351538 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.5629506 Nov 24 16:05:09.128186 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58332) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:09.137574 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.153681 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:09.286218 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:09.347306 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58334) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:09.408276 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.427983 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.518276 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.560097 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.564918 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:09.598953 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=3d045898-91ac-4634-b168-eeaa9c87f097,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:09.704774 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Allocated IP 172.20.0.2 (d785b693-1522-4c61-9c47-37993ec7d517/6f721a8b-2f8a-4509-b0fb-4eea2f82fd87/2979a199-79d3-4f57-925e-0ba22f53d24b) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:09.786302 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:06Z', 'revision_number': 3, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:09.943374 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:09.945474 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Updating router 4659895c-56b7-4459-9ba6-d88a8c81621f port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:09.976394 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.001343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.db.api [None req-0746cde9-f783-43f7-9092-02eed3f39dd1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102789) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 16:05:10.004227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG oslo_db.api [None req-0746cde9-f783-43f7-9092-02eed3f39dd1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 16:05:10.045480 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.047063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.048901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:10.049758 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.059922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1015} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:05:10.070940 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.100769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-263d8f91-568f-4250-baa3-aa8966d8cea2 None None] Network df42b516-6753-481b-a21c-74d7dd325e73 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:10.117532 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=529346e9-ab6d-4a44-8109-45445b3ecb84,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:10.179409 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.180131 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Added segment 02833ec3-3410-4203-939b-a89b1f0c3745 of type vlan for network fafb4435-765d-4616-9638-8248f7ef836b Nov 24 16:05:10.258666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] Pushing event updated for resources: {'Network': ['ID=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:10.317312 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.347728 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-be426395-dab7-408b-a0b7-2f60652485f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.364320 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.385213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:05:10.491602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-be426395-dab7-408b-a0b7-2f60652485f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.515517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-be426395-dab7-408b-a0b7-2f60652485f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.646551 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-be426395-dab7-408b-a0b7-2f60652485f6 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f1e485f96ae44fb0b4cf69f3ecf456a7&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2864635 Nov 24 16:05:10.648863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be426395-dab7-408b-a0b7-2f60652485f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc4d9c83-c0e1-4147-aef8-9f861afd9844,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:10.658345 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-2b8192c4-1d67-4029-9305-20af0bba093c admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 3.6476812 Nov 24 16:05:10.658994 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58374) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:10.668500 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58376) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:10.692303 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Request body: {'subnet': {'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-447883267-subnet', 'tenant_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:10.742842 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.751935 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58378) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:10.792805 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.795282 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.802523 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.899126 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.db.resource_extend [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 16:05:10.906659 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Attempting to bind port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:10.907257 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Attempting to bind port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:10.907614 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Attempting to bind port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:10.929370 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:10.929745 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:10.930198 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.931210 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:10.931753 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Bound port: eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:10.932100 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Made reservation on behalf of c127095ad8cc41098ef0dd79f4fcd589 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:10.932261 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.934888 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.953257 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:10.954246 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.003495 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.014495 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.016895 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.017091 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:11.018099 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.109598 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Pushing event updated for resources: {'Port': ['ID=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,revision_number=2']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.141559 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.141909 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.142272 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.142613 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.142960 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.143293 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.143631 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.143965 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.144392 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.144652 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.144983 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.161302 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Tracked resource versions report: Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: pushed versions: Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: { 'AddressGroup': {'1.2'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'ConntrackHelper': {'1.0'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Log': {'1.0'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Network': {'1.1'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Port': {'1.7'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'PortForwarding': {'1.2'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'QosPolicy': {'1.10'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroup': {'1.5'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SubPort': {'1.0'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Subnet': {'1.1'}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Trunk': {'1.1'}} Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: consumer versions: Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: { DHCP agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: HyperV agent@hv-cinder-81899: {}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: L3 agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: Metadata agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: Metering agent@dv-cinder-818994-2-iscsi: {}, Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: Open vSwitch agent@dv-cinder-818994-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'ConntrackHelper': '1.0', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Log': '1.0', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Network': '1.1', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Port': '1.7', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'PortForwarding': '1.2', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'QosPolicy': '1.10', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroup': '1.5', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SecurityGroupRule': '1.2', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'SubPort': '1.0', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Subnet': '1.1', Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: 'Trunk': '1.1'}} Nov 24 16:05:11.162395 dv-cinder-818994-2-iscsi neutron-server[102790]: {{(pid=102790) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:05:11.201715 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] For port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:11.205248 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] Pushing event updated for resources: {'Network': ['ID=fafb4435-765d-4616-9638-8248f7ef836b,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.209957 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Allocated IP 172.27.0.131 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/80bf6606-45fd-4eed-91cc-ef6dbae00eb0) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:11.219082 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Network d785b693-1522-4c61-9c47-37993ec7d517 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:11.224232 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] For port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:11.234601 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.260709 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:11.279378 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:11.325684 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Allocated IP 172.20.0.1 (282e5dca-255c-487d-a4fd-a70d7293f6b8/2243cd13-32e0-4ca8-9d04-3e463c6c8988/838c6cdf-c823-41c0-8fd9-23daaee0913f) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:11.342739 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network fafb4435-765d-4616-9638-8248f7ef836b details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:05:11.368736 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-012a8eff-e5bc-44c7-a2a4-75193fd0c8f6 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 3.7467713 Nov 24 16:05:11.380369 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Pushing event updated for resources: {'Port': ['ID=2979a199-79d3-4f57-925e-0ba22f53d24b,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.393273 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58394) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:11.412850 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-a63d9645-eba3-4fdf-a651-0789ee91b52c None None] Provisioning complete for port 3d045898-91ac-4634-b168-eeaa9c87f097 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:11.413664 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a63d9645-eba3-4fdf-a651-0789ee91b52c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.423731 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 3d045898-91ac-4634-b168-eeaa9c87f097 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:11.427902 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Request body: {'subnet': {'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1491751026-subnet', 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:11.479342 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:11.480414 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:11.549396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ec248fa-6a91-492e-9145-61a062e79ec1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.580953 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.641640 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.644263 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.651404 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/cc4d9c83-c0e1-4147-aef8-9f861afd9844 HTTP/1.1" status: 204 len: 168 time: 0.9879837 Nov 24 16:05:11.701894 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:11.714765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820eb4cb-bb94-4a82-a1f8-4a70a809c4b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc4d9c83-c0e1-4147-aef8-9f861afd9844,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.722796 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:11.727523 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.749337 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.900837 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:11.921221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:11.936221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:11.937562 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:11.942654 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Pushing event updated for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.959625 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb286cd-c5f7-4123-b496-9104e29d33a9 None None] Pushing event updated for resources: {'Port': ['ID=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:11.998244 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ec248fa-6a91-492e-9145-61a062e79ec1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.006332 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ec248fa-6a91-492e-9145-61a062e79ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.017088 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:06Z', 'revision_number': 3, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:12.023034 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Attempting to bind port 2979a199-79d3-4f57-925e-0ba22f53d24b on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:12.023416 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Attempting to bind port 2979a199-79d3-4f57-925e-0ba22f53d24b by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:12.023788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Attempting to bind port 2979a199-79d3-4f57-925e-0ba22f53d24b on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:12.034174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:12.034889 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Checking segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:12.035306 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.035740 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Bound using segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:12.036796 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Bound port: 2979a199-79d3-4f57-925e-0ba22f53d24b, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:12.037103 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.090941 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 3d045898-91ac-4634-b168-eeaa9c87f097 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:12.091608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.100345 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e18f493-333c-487a-9c8d-5a0fa57f5ad5 None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:06Z', 'revision_number': 3, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:12.207214 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-1ec248fa-6a91-492e-9145-61a062e79ec1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c467c19ef02147d498497f8c42fe47f9&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4217563 Nov 24 16:05:12.208435 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec248fa-6a91-492e-9145-61a062e79ec1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a237279b-0932-4835-b362-476bb6362170,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:12.211224 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58400) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:12.262865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.337257 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58402) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:12.367040 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.376350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3f5778c9-4aef-4c52-81c0-01f78f12c8b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.427078 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.508264 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] For port 2979a199-79d3-4f57-925e-0ba22f53d24b, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:12.512601 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] For port 2979a199-79d3-4f57-925e-0ba22f53d24b, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=2979a199-79d3-4f57-925e-0ba22f53d24b,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:12.597328 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.636305 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.667661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.670244 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.676820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.677590 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.682208 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.732133 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.736778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.744424 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.748418 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a237279b-0932-4835-b362-476bb6362170 HTTP/1.1" status: 204 len: 168 time: 0.5333145 Nov 24 16:05:12.798474 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e81b6c3-8043-4f84-b21c-52a34c1a3ba9 None None] Pushing event updated for resources: {'Port': ['ID=2979a199-79d3-4f57-925e-0ba22f53d24b,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:12.819722 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:12.831375 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-9ba74815-ec2c-4ea9-89d9-433c932bbafc None None] Provisioning complete for port 838c6cdf-c823-41c0-8fd9-23daaee0913f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:12.831743 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9ba74815-ec2c-4ea9-89d9-433c932bbafc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.867357 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:12.883473 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:12.889597 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Pushing event updated for resources: {'Port': ['ID=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:12.892922 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62160585-4b11-4c24-aab3-4f6c38c14275 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a237279b-0932-4835-b362-476bb6362170,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:12.898205 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-9ba74815-ec2c-4ea9-89d9-433c932bbafc None None] Port 838c6cdf-c823-41c0-8fd9-23daaee0913f cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:12.925370 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Pushing event updated for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:12.955101 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3f5778c9-4aef-4c52-81c0-01f78f12c8b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:12.989015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3f5778c9-4aef-4c52-81c0-01f78f12c8b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.145948 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5778c9-4aef-4c52-81c0-01f78f12c8b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22cb5a31-e7a3-4391-ae09-963f0bf66685,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:13.160712 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-3f5778c9-4aef-4c52-81c0-01f78f12c8b1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a5639d6dbcff4f63b1ed6dc6b2637ba6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8205848 Nov 24 16:05:13.172990 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58416) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:13.181600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Pushing event updated for resources: {'Subnet': ['ID=73ce2b53-9439-498a-9f86-2224119f5b5b,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:13.258544 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:13.272867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:13.388289 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.483183 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Checking segment: {'id': 'cfd8620d-0436-44f1-9416-05a3b74c08b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1036, 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:13.484194 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Network hostable DHCP agents. Network: 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:05:13.561390 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 2979a199-79d3-4f57-925e-0ba22f53d24b up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:13.566633 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.652907 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Checking segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:13.653593 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Network hostable DHCP agents. Network: fafb4435-765d-4616-9638-8248f7ef836b, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:05:13.675892 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3e375f9-d96e-4117-a4ce-55baac3893ba,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:13.690589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.696080 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:05:13.736908 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 2979a199-79d3-4f57-925e-0ba22f53d24b triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:13.738738 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.765100 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.830676 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:05:13.831648 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:13.852242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-def40b03-4d39-4c17-b0f1-588d2061abe2 None None] Network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:13.889793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.890662 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2d02f1ca-0657-4657-91ee-2b985b20afc7 None None] Provisioning complete for port 838c6cdf-c823-41c0-8fd9-23daaee0913f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:13.891187 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2d02f1ca-0657-4657-91ee-2b985b20afc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.961212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.963712 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:13.964853 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/22cb5a31-e7a3-4391-ae09-963f0bf66685 HTTP/1.1" status: 204 len: 168 time: 0.7904115 Nov 24 16:05:14.003629 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a21fc7f-682e-48b5-9735-c2f56f7b56aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22cb5a31-e7a3-4391-ae09-963f0bf66685,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:14.007688 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-2d02f1ca-0657-4657-91ee-2b985b20afc7 None None] Port 838c6cdf-c823-41c0-8fd9-23daaee0913f cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:14.103985 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:14.230866 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:14.248534 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c05ccfa1-88fe-4265-9a97-209ddb6454cb admin admin] 10.222.0.72 "PUT /v2.0/routers/4659895c-56b7-4459-9ba6-d88a8c81621f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5010400 Nov 24 16:05:14.264382 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 2979a199-79d3-4f57-925e-0ba22f53d24b, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=2979a199-79d3-4f57-925e-0ba22f53d24b,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:14.275919 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:14.282152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:14.308988 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:14.310420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:14.419088 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Network fafb4435-765d-4616-9638-8248f7ef836b is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:05:14.529664 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, fafb4435-765d-4616-9638-8248f7ef836b) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:14.548096 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca73c64c-18ed-4baf-910e-ecc2558f161f None None] Network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:14.583242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b34c9704-de7a-4c00-ac21-6a0da6c99a13 None None] Network fafb4435-765d-4616-9638-8248f7ef836b requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:14.594007 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:14.594993 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:14.614531 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4b982d89-a927-4afd-98c3-fae3f2bcad4a admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 3.9399209 Nov 24 16:05:14.632548 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:14.798288 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-77738832-0acf-4c29-982e-ca45d7f99f45 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 3.3737326 Nov 24 16:05:14.814620 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-163cf522-4aac-43c1-93a1-7191f36f0c29 None None] Network d785b693-1522-4c61-9c47-37993ec7d517 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:14.872503 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=2979a199-79d3-4f57-925e-0ba22f53d24b,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:14.938593 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Allocated IP 172.27.0.83 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/6ab2d27d-63ea-4073-b58e-fafbd0a79b46) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:15.122547 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:15.152330 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-eb92654b-2513-490c-944e-f5be4c7740bd None None] Provisioning complete for port 2979a199-79d3-4f57-925e-0ba22f53d24b triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:15.152939 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-eb92654b-2513-490c-944e-f5be4c7740bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:15.214608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3630db1-934f-493a-b19c-3da89a0eddd5 None None] Network fafb4435-765d-4616-9638-8248f7ef836b requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:05:15.225314 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:15.225800 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:15.342571 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:15.345857 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:15.569110 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:15.570144 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:15.576422 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:15.659761 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Pushing event updated for resources: {'Port': ['ID=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:15.718817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:15.732437 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:15.738506 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:15.900029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58510) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:15.903010 dv-cinder-818994-2-iscsi neutron-server[102788]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 16:05:16.024315 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102787) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:05:16.095609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58520) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:16.100917 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:16.193955 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.202696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1373701052', 'description': 'tempest-description--9462290'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:16.353442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-9ef432cd-163e-4665-b5f7-a054efb1189a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:16.355405 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-9ef432cd-163e-4665-b5f7-a054efb1189a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/networks?id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 HTTP/1.1" status: 200 len: 811 time: 0.4535568 Nov 24 16:05:16.359406 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.376269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.399636 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-e6f2a304-f554-4b4a-845a-dbd142e5302f tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/quotas/c127095ad8cc41098ef0dd79f4fcd589 HTTP/1.1" status: 200 len: 375 time: 0.0168600 Nov 24 16:05:16.473823 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:16.483368 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.502244 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-8d57ff51-7bf2-4198-a583-5a63ab0d4362 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=c127095ad8cc41098ef0dd79f4fcd589&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0924454 Nov 24 16:05:16.640686 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.649327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.695150 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.697136 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.6001899 Nov 24 16:05:16.706513 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:16.707305 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58538) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:16.719567 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:16.720596 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group_rule': {'security_group_id': '4aeec843-cb50-445f-8ffc-28ad4505fe5b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:16.724644 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 2979a199-79d3-4f57-925e-0ba22f53d24b up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:16.748123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.749746 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-cb1dd46b-600c-4566-806c-ff7095a2fb07 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 9.7892628 Nov 24 16:05:16.755227 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58540) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:16.755776 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:16.758498 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:16.770154 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51bb9afe-3f37-4df1-8e20-635612a1eb87 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4aeec843-cb50-445f-8ffc-28ad4505fe5b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:16.845407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:16.997055 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58546) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:17.041416 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.043368 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:17.078786 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:17.123931 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.126125 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58564) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:17.132552 dv-cinder-818994-2-iscsi neutron-server[102787]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 16:05:17.133891 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.201005 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=505e3129-2e26-4854-94b3-448b4d29e582,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:17.227523 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.231179 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d1312e34-9c51-441e-9074-a39123e88d31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5156000 Nov 24 16:05:17.235507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58566) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:17.247179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group_rule': {'security_group_id': '4aeec843-cb50-445f-8ffc-28ad4505fe5b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:17.259001 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 2979a199-79d3-4f57-925e-0ba22f53d24b triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:17.260045 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.372546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-e8689dd2-0ba1-4961-9b96-906939f90fc9 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:05:17.376498 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-e8689dd2-0ba1-4961-9b96-906939f90fc9 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1002424 Nov 24 16:05:17.377924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.410220 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 2, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:17.478998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:17.479350 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Updating router 4659895c-56b7-4459-9ba6-d88a8c81621f port 838c6cdf-c823-41c0-8fd9-23daaee0913f binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:17.567821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.596131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dd39690d-1467-4f54-a56d-07a6c84f11d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.651198 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-57d74b42-419f-4dac-a7af-01500c9242c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:17.659057 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-57d74b42-419f-4dac-a7af-01500c9242c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.5293572 Nov 24 16:05:17.666968 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:13Z', 'revision_number': 3, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:17.692609 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-ab02ae42-8858-4afd-b758-a28d09d26d19 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/quotas/20c9176ab8ef44ffb17eda5f41aca2a8 HTTP/1.1" status: 200 len: 375 time: 0.0324864 Nov 24 16:05:17.715850 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-e18d3108-5730-4d31-b003-98dfb1a4b36e None None] Provisioning complete for port 2979a199-79d3-4f57-925e-0ba22f53d24b triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:17.721543 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-e18d3108-5730-4d31-b003-98dfb1a4b36e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.740551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.772096 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.800057 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:17.800923 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Updating router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:17.808526 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-95491922-2442-4b33-ac1f-c8f5bd29090f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1148374 Nov 24 16:05:17.839577 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de8c86c2-0045-4011-baf4-8ec3c9ea386d,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:17.884355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.892678 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d2f97a2a-6ea8-4875-a3d8-42f59f11d89c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6558168 Nov 24 16:05:17.897825 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-da778ff3-b2fa-4c7f-aacc-b7039c668254 service neutron] 10.222.0.72 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4479296 Nov 24 16:05:17.899647 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58586) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:17.901810 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:17.907417 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Router 4579744e-a72c-42e1-b184-5969c9b2caec is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102787) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:05:17.920551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:18.037347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.057346 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:05:18.374221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dd39690d-1467-4f54-a56d-07a6c84f11d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.402716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.408146 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-aeaba281-2ed6-453c-b2bc-c7713db797a7 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:05:18.415184 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-aeaba281-2ed6-453c-b2bc-c7713db797a7 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2718563 Nov 24 16:05:18.421967 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.463911 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dd39690d-1467-4f54-a56d-07a6c84f11d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.546899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5e2581-62d2-4887-b027-a4b8bfb7ed62 None None] Pushing event updated for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:18.622236 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-dd39690d-1467-4f54-a56d-07a6c84f11d8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c01328178e9c454d847e6574d8563d85&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6226499 Nov 24 16:05:18.636804 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58602) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:18.641877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:18.648361 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.659575 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.704687 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Sync routers for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:18.730916 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0b595909-de22-4813-8266-b461b543ba39 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.742634 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.744757 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-fbe4f64f-99fc-4097-8167-17bf0348f108 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 9.6049922 Nov 24 16:05:18.759229 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58606) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:18.761940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:18.808138 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2962d0-064a-45b7-a005-b5ae53b3b8ef None None] Pushing event updated for resources: {'Port': ['ID=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,revision_number=2']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:18.808761 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Attempting to bind port 838c6cdf-c823-41c0-8fd9-23daaee0913f on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:18.808761 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Attempting to bind port 838c6cdf-c823-41c0-8fd9-23daaee0913f by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:18.809940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Attempting to bind port 838c6cdf-c823-41c0-8fd9-23daaee0913f on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:18.846471 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Attempting to bind port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:18.847715 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Attempting to bind port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:18.848196 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Attempting to bind port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:18.848322 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:18.849250 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:18.855084 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:18.855536 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:18.856040 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.856516 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:18.857114 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Bound port: 80bf6606-45fd-4eed-91cc-ef6dbae00eb0, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:18.857609 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.940544 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-7b10691c-d0c8-4f94-a9e3-16f660b495e8 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4917977 Nov 24 16:05:18.960615 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:18.991157 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] For port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:18.994473 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] For port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:19.009493 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.014473 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd39690d-1467-4f54-a56d-07a6c84f11d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29d92d83-6eea-432f-a297-aa56ab4562dd,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:19.076594 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2962d0-064a-45b7-a005-b5ae53b3b8ef None None] Pushing event updated for resources: {'Port': ['ID=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:19.101677 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-8721a528-a7fc-4934-8260-f95375e7ee20 service neutron] 10.222.0.72 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1180992 Nov 24 16:05:19.109956 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:19.111732 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:19.112378 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:19.196235 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.234970 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:19.235358 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Checking segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:19.236006 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.238606 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Bound using segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:19.239435 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Bound port: 838c6cdf-c823-41c0-8fd9-23daaee0913f, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:19.240061 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.294220 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.343601 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:19.379983 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Allocated IP 172.27.0.121 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/c71e42b6-5b44-40cf-b61f-d2da3621a0a7) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:19.497433 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.619253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.627868 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.633115 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/29d92d83-6eea-432f-a297-aa56ab4562dd HTTP/1.1" status: 204 len: 168 time: 0.9929683 Nov 24 16:05:19.642312 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2f33dace-c01a-4bae-b1bd-7e5279fe6468 None None] Provisioning complete for port 838c6cdf-c823-41c0-8fd9-23daaee0913f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:19.643130 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2f33dace-c01a-4bae-b1bd-7e5279fe6468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.698864 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-2f33dace-c01a-4bae-b1bd-7e5279fe6468 None None] Port 838c6cdf-c823-41c0-8fd9-23daaee0913f cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:19.700714 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:19.701257 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.720450 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.724973 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a15a9bcd-6795-4cb0-9e7b-e6be1faf41e0 req-0c6e74c2-7162-4c80-bbf5-5a392fd192e1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.1080322 Nov 24 16:05:19.837114 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] For port 838c6cdf-c823-41c0-8fd9-23daaee0913f, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:19.856772 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:19.865876 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-ca8cb875-32be-4e67-b7c2-6111bae977a0 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8935368 Nov 24 16:05:19.883363 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26232c17-34b3-464e-8396-97ae4715f399 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29d92d83-6eea-432f-a297-aa56ab4562dd,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:19.941173 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] For port 838c6cdf-c823-41c0-8fd9-23daaee0913f, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=838c6cdf-c823-41c0-8fd9-23daaee0913f,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:19.995200 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:13Z', 'revision_number': 3, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:20.021814 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Allocated IP 172.20.0.1 (d785b693-1522-4c61-9c47-37993ec7d517/6f721a8b-2f8a-4509-b0fb-4eea2f82fd87/c30a2f5a-8b67-4015-bf85-aad19ac790a9) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:20.037572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:20.110265 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:20.111998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=c71e42b6-5b44-40cf-b61f-d2da3621a0a7,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:20.124986 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:20.134267 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:20.149424 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b70791cc-38a7-4721-9a3a-6ae8fc93118b None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:13Z', 'revision_number': 3, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:20.316397 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5e2581-62d2-4887-b027-a4b8bfb7ed62 None None] Pushing event updated for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:20.462245 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:20.462624 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:04:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:20.599865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:20.607440 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c298b9ec-5af8-4ab3-9502-c62a1086d328 req-49dd0cf4-5684-40b2-ab7c-d02f80f5dff9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.1340561 Nov 24 16:05:20.680016 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:20.769665 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 3, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:21.025496 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.113990 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:21.174441 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0cb4acf6-23a9-4ff0-8ab1-7ac75f2ee532 req-4bc03cfd-6c13-41b9-9ab8-e3507af9d6c9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.1629109 Nov 24 16:05:21.189785 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58686) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:21.198402 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Checking router: 4579744e-a72c-42e1-b184-5969c9b2caec for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:21.205555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Updating router 4579744e-a72c-42e1-b184-5969c9b2caec port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:21.316977 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.404211 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.684849 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Network d785b693-1522-4c61-9c47-37993ec7d517 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:21.689832 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.707384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.725449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.736512 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:21.750703 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:21.755248 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.918256 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:21.974011 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:22.097860 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=c71e42b6-5b44-40cf-b61f-d2da3621a0a7,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:22.184712 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a65d4818-7350-4cf0-b8d6-69e8d2968734 req-9f3a7ccd-9ee4-4cf3-8d06-c894aa3ab080 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.3074138 Nov 24 16:05:22.216041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:22.221793 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-4b442af1-85e6-4ff3-bfa8-075e80116c09 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.3095069 Nov 24 16:05:22.361471 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Pushing event updated for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:22.402289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] Provisioning complete for port 838c6cdf-c823-41c0-8fd9-23daaee0913f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:22.403059 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:22.501949 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-52773f04-8c0a-47ae-a36b-5db1ef9355e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:22.724145 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fb1dbfa-0df3-4c16-bf3f-e82a086964d3 req-af9f4e04-9f92-436e-9f07-0d47120143eb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.3220034 Nov 24 16:05:22.914576 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-54e0f216-f16d-4af4-8686-90518a849f37 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--1373701052&fields=id&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 267 time: 0.1711392 Nov 24 16:05:22.918826 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:22.971852 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:22.991892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d631a417-b931-4c9b-b8be-e10625476b7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.209654 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-399ba7fe-dc20-48a3-be93-3b845969a34a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:23.230742 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-399ba7fe-dc20-48a3-be93-3b845969a34a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 816 time: 0.3046322 Nov 24 16:05:23.234911 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5d47ed-c15f-40d0-802b-f45676cd53ab None None] Pushing event updated for resources: {'Port': ['ID=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:23.249860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Attempting to bind port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:23.250886 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Attempting to bind port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:23.251812 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Attempting to bind port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:23.265960 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-58811b3b-b3bb-4c00-90a4-ab83e90dd01f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/quotas/4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 375 time: 0.0339642 Nov 24 16:05:23.274631 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:23.275678 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.350074 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:23.350931 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:23.351715 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.352676 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:23.353600 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Bound port: 6ab2d27d-63ea-4073-b58e-fafbd0a79b46, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:23.354865 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.439363 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-13159739-6d06-4b11-8afe-c04c5fe4182a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1723602 Nov 24 16:05:23.479948 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] For port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:23.486352 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] For port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:23.518504 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.546237 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.583516 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b89e9930-b450-4c80-ad0a-ac01836f6bd7 req-30e75469-c5a7-4871-9597-a188c192560a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.2150378 Nov 24 16:05:23.719199 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-3159f30b-b5a3-45d9-b3b3-1a26198481b5 service neutron] 10.222.0.72 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2747226 Nov 24 16:05:23.815624 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Allocated IP 172.20.0.1 (df42b516-6753-481b-a21c-74d7dd325e73/e60a04ed-2a73-4097-a8e3-582d7b1a8d1f/dc2bf933-b2d7-4297-b8f9-05a72735f52c) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:23.865490 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:23.951644 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-dd0bb19b-9524-4a04-8d59-425c661b5ddc service neutron] 10.222.0.72 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2354596 Nov 24 16:05:24.107123 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:24.108648 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:22Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:24.122719 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5d47ed-c15f-40d0-802b-f45676cd53ab None None] Pushing event updated for resources: {'Port': ['ID=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:24.189906 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.208568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.373455 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:24.400553 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.490741 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 req-644e7227-c732-4729-9f99-210ebd4ca17d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.0932596 Nov 24 16:05:24.517524 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] For port 838c6cdf-c823-41c0-8fd9-23daaee0913f, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=838c6cdf-c823-41c0-8fd9-23daaee0913f,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:24.531491 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.555203 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.557311 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.567139 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:19Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:24.625137 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:24.627899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddc3b856-9f09-4ea8-8392-09f80125dc1f None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:19Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:24.766049 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.872453 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.877604 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-52773f04-8c0a-47ae-a36b-5db1ef9355e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:24.909278 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-67f55eb4-d146-40a0-9144-21424f576e37 req-a7a39b11-24fd-4a62-85d1-8408fde9c524 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.2145593 Nov 24 16:05:24.939939 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-52773f04-8c0a-47ae-a36b-5db1ef9355e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.007088 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:25.011040 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-52773f04-8c0a-47ae-a36b-5db1ef9355e8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=9272cea811154cd89e6ec96dcd2f301b&name=default HTTP/1.1" status: 200 len: 2996 time: 3.8194706 Nov 24 16:05:25.015252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58816) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:25.165339 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Network df42b516-6753-481b-a21c-74d7dd325e73 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:25.221649 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.229849 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.244410 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Pushing event updated for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:25.261425 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:25.299106 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.71', 55163) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:25.333429 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ef744a58-266d-4693-b391-eed592c93a6b req-99235e55-876f-47ef-ad16-fe0ab63320e5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.1719146 Nov 24 16:05:25.341411 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52773f04-8c0a-47ae-a36b-5db1ef9355e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f8b3979-8c6a-452b-aeca-8d81c961be17,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:25.356893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.356893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.535120 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:25.539138 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.574651 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ef2519-98e2-47b2-86f3-6f10f4c379f1 None None] Pushing event updated for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:25.610615 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-74c703e7-ccfe-4ff9-8f8f-8f2179ecc4ba None None] Provisioning complete for port c30a2f5a-8b67-4015-bf85-aad19ac790a9 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:25.611659 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-74c703e7-ccfe-4ff9-8f8f-8f2179ecc4ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.722312 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.877507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.886574 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:25.892421 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9f8b3979-8c6a-452b-aeca-8d81c961be17 HTTP/1.1" status: 204 len: 168 time: 0.8674431 Nov 24 16:05:25.936862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16141f0-e632-43b6-936b-4a9742ea9776 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f8b3979-8c6a-452b-aeca-8d81c961be17,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:25.939735 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-74c703e7-ccfe-4ff9-8f8f-8f2179ecc4ba None None] Port c30a2f5a-8b67-4015-bf85-aad19ac790a9 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:25.996029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-38408373-2384-4c5b-a62a-f678b51a2675 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:25.998211 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-38408373-2384-4c5b-a62a-f678b51a2675 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.6634369 Nov 24 16:05:26.067041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Request body: {'port': {'device_id': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'admin_state_up': True, 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:26.156865 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Network d785b693-1522-4c61-9c47-37993ec7d517 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:26.158022 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Pushing event updated for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:26.169478 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.71', 55168) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:26.173661 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-58064941-947a-4145-a7b8-c477cefe980c req-3d88107d-7415-45d4-9e82-de6a54f0a6fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.3594902 Nov 24 16:05:26.195589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:26.396423 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d792e822-ffc6-4a82-a823-adcf9add106c req-005ca45d-7e28-454c-935d-d9163d542a3b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.1684241 Nov 24 16:05:26.568170 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 3, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:26.807722 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f1c07e-2fab-49e6-aee8-01c1a93b2b9e None None] The sync data for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi is: [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 3, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:26.898035 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:26.899073 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:26.907040 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:27.279404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 58888) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:27.306105 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:27.395002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d9a0f84b-ba77-452f-90d6-5587bf666acf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:27.476575 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-da2e54c7-aae2-4388-a876-11ce64e079d1 req-a232a3e4-f862-46ab-9476-7da99ad9bf02 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.6202891 Nov 24 16:05:27.494300 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-658b0071-4862-40fe-a82f-87eaf12163b0 None None] Provisioning complete for port c30a2f5a-8b67-4015-bf85-aad19ac790a9 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:27.495036 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-658b0071-4862-40fe-a82f-87eaf12163b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:27.644524 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Allocated IP 172.20.0.2 (fafb4435-765d-4616-9638-8248f7ef836b/d3e375f9-d96e-4117-a4ce-55baac3893ba/691eb29c-951c-4f72-b283-76d5f14e961e) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:27.690324 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:27.690967 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:27.845326 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:05:27.850641 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.71', 55173) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:27.860486 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-658b0071-4862-40fe-a82f-87eaf12163b0 None None] Port c30a2f5a-8b67-4015-bf85-aad19ac790a9 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:27.961962 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 838c6cdf-c823-41c0-8fd9-23daaee0913f up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:28.037863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d9a0f84b-ba77-452f-90d6-5587bf666acf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:28.080426 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 838c6cdf-c823-41c0-8fd9-23daaee0913f triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:28.080799 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:28.147095 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-472f3267-b179-4caa-8398-e86e58ba75c2 req-332ca8f6-1efb-4d26-a84c-1e3805d50ba7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.3537717 Nov 24 16:05:28.171428 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d9a0f84b-ba77-452f-90d6-5587bf666acf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:28.229251 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-d87197d0-6ea4-4721-93e5-d11e65328e8e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:28.232500 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-d87197d0-6ea4-4721-93e5-d11e65328e8e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.71 "GET /v2.0/networks?id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 HTTP/1.1" status: 200 len: 811 time: 2.0569737 Nov 24 16:05:28.273660 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91afdc3-21f1-4ecb-be14-20005df22e8d req-ac89f1bd-0664-4a82-9884-eeb9f9fb773e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.5744443 Nov 24 16:05:28.314001 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d9a0f84b-ba77-452f-90d6-5587bf666acf admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a9f15e0e50fb472793fe8483cdc0b6cb&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0279517 Nov 24 16:05:28.406200 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-b2942027-3843-4d15-8b6e-49dc5134793a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:28.416386 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-b2942027-3843-4d15-8b6e-49dc5134793a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 816 time: 0.5354054 Nov 24 16:05:28.417483 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58902) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:28.446353 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Request body: {'port': {'device_id': '4070b904-d207-48f3-b522-209d11d5291c', 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7', 'admin_state_up': True, 'tenant_id': 'c127095ad8cc41098ef0dd79f4fcd589'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:28.614589 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a0f84b-ba77-452f-90d6-5587bf666acf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9e7f933-8c3f-4beb-b699-8225036a3241,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:28.777710 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:28.858131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:28.989894 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:28.996624 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.001109 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.020202 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806437b8-8b10-403a-b0bc-fb80babfa261 req-af12f30d-427e-4329-a961-0dfd47c0c17a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.1554296 Nov 24 16:05:29.351863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.417278 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:29.431127 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.588172 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 req-650dfe5d-dc8f-46b8-9944-f0e9d2df9474 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.2680080 Nov 24 16:05:29.593083 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Network fafb4435-765d-4616-9638-8248f7ef836b is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:29.595240 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event updated for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:29.610840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:29.618397 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:29.634078 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Made reservation on behalf of c127095ad8cc41098ef0dd79f4fcd589 for: {'port': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:29.638605 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.657621 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:29.659047 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:29.762518 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:29.792065 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-a7c0accf-8da1-4fa6-bd21-38ae06ec77bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7358596 Nov 24 16:05:29.905512 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-dc6bba34-3297-4681-9c8f-a273be0304e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 380 time: 1.4130940 Nov 24 16:05:29.981937 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:30.001519 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:30.021438 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:30.022231 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:22Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:30.101000 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a5d04985-b7fa-406e-90dc-d729dfae283a admin admin] 10.222.0.72 "PUT /v2.0/routers/eb40aed5-eb33-44c4-ad15-8fb8e02c47ba/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.3296633 Nov 24 16:05:30.101000 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 req-11658d1e-c4bc-401e-bcc6-bdf1404e467a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.3106172 Nov 24 16:05:30.325804 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:30.358544 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-54ca8b14-7e9e-4fb1-95c1-0deb1a7c0123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:05:30.366458 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-54ca8b14-7e9e-4fb1-95c1-0deb1a7c0123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0190723 Nov 24 16:05:30.477231 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:30.517004 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'port': {'device_id': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'admin_state_up': True, 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'security_groups': ['4aeec843-cb50-445f-8ffc-28ad4505fe5b']}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:30.554385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 req-314796eb-e9e7-4c52-9230-ad873f5a9fe2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:30.605728 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 req-314796eb-e9e7-4c52-9230-ad873f5a9fe2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 931 time: 0.3578188 Nov 24 16:05:30.613117 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:30.617327 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:30.636572 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:30.682896 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:30.912031 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:30.913471 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.004590 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.022033 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 req-848ba16a-ff6f-44f8-9ef9-e963d49da7b4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4030859 Nov 24 16:05:31.149505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Request body: {'port': {'device_id': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:31.275331 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 2, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:31.336729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.412104 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:31.412989 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Updating router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba port c30a2f5a-8b67-4015-bf85-aad19ac790a9 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:31.503182 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.508180 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.518580 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:31.520866 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b9e7f933-8c3f-4beb-b699-8225036a3241 HTTP/1.1" status: 204 len: 168 time: 3.0366728 Nov 24 16:05:31.698040 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627c52b5-44bf-4625-9b0f-48c6b1caf04e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9e7f933-8c3f-4beb-b699-8225036a3241,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:31.940752 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 58972) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:31.981816 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group': {'name': 'tempest-securitygroup--722220740', 'description': 'tempest-description--1052642911'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:32.271979 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Pushing event updated for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:32.385494 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:32.386385 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 req-0eadc3b9-0691-49d0-b865-10b7f442eccb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.1902945 Nov 24 16:05:32.403108 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:32.535840 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Allocated IP 172.20.0.13 (3a3f8b84-e6ed-4689-a795-ab7b4d769ab7/73ce2b53-9439-498a-9f86-2224119f5b5b/af829109-ec6d-4b1f-b501-099d680019fe) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:32.607432 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f22205-783d-4659-8660-67d8b0d88e52 None None] Pushing event updated for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:32.675480 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:32.809380 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Attempting to bind port c30a2f5a-8b67-4015-bf85-aad19ac790a9 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:32.809968 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Attempting to bind port c30a2f5a-8b67-4015-bf85-aad19ac790a9 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:32.810548 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Attempting to bind port c30a2f5a-8b67-4015-bf85-aad19ac790a9 on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:32.821249 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:32.821831 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Checking segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:32.822470 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:32.823377 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Bound using segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:32.824155 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Bound port: c30a2f5a-8b67-4015-bf85-aad19ac790a9, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:32.824964 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:32.959887 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] For port c30a2f5a-8b67-4015-bf85-aad19ac790a9, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:32.966354 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] For port c30a2f5a-8b67-4015-bf85-aad19ac790a9, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c30a2f5a-8b67-4015-bf85-aad19ac790a9,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:32.972314 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 req-56099999-b6c1-4289-b1dc-cbd34b620efd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.6780975 Nov 24 16:05:32.976847 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.135164 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f22205-783d-4659-8660-67d8b0d88e52 None None] Pushing event updated for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:33.149517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6327470a-cb9b-4d54-ab28-e81bf4db10bd req-f4e5e7ce-3e03-4d55-b0be-3bb7d7d7f421 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:33.156954 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:33.157883 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:22Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:33.159878 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6327470a-cb9b-4d54-ab28-e81bf4db10bd req-f4e5e7ce-3e03-4d55-b0be-3bb7d7d7f421 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 931 time: 0.4055748 Nov 24 16:05:33.232913 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] Provisioning complete for port c30a2f5a-8b67-4015-bf85-aad19ac790a9 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:33.252645 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.301612 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 691eb29c-951c-4f72-b283-76d5f14e961e {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:33.319746 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.348077 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6327470a-cb9b-4d54-ab28-e81bf4db10bd req-081cbe99-b1b6-4347-a456-f094d70fa132 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859200 Nov 24 16:05:33.396366 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Transition to ACTIVE for port object 691eb29c-951c-4f72-b283-76d5f14e961e will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:33.406465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.466765 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Made reservation on behalf of 4ca913475fb04e7a8ea75d95578c8b84 for: {'port': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:33.476630 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:33.487890 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.586793 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Pushing event updated for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:33.628222 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Network df42b516-6753-481b-a21c-74d7dd325e73 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:33.642561 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.642975 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:33.754641 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] For port c30a2f5a-8b67-4015-bf85-aad19ac790a9, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c30a2f5a-8b67-4015-bf85-aad19ac790a9,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:33.768185 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:33.846401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Attempting to bind port 691eb29c-951c-4f72-b283-76d5f14e961e on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:33.847945 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Attempting to bind port 691eb29c-951c-4f72-b283-76d5f14e961e by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:33.848871 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Attempting to bind port 691eb29c-951c-4f72-b283-76d5f14e961e on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:33.860033 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Port 691eb29c-951c-4f72-b283-76d5f14e961e on network fafb4435-765d-4616-9638-8248f7ef836b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:33.864771 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Attempting to bind port 691eb29c-951c-4f72-b283-76d5f14e961e on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:33.886741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:33.887820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Checking segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:33.890970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Bound using segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:33.892269 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Bound port: 691eb29c-951c-4f72-b283-76d5f14e961e, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:33.893198 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.035118 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-3c37a778-a537-457c-b94e-b0b3169c28cb None None] Provisioning complete for port c30a2f5a-8b67-4015-bf85-aad19ac790a9 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:34.035118 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c37a778-a537-457c-b94e-b0b3169c28cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.223105 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9432b000-2c0b-4c35-9d47-b2fc64101c73 None None] Pushing event updated for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:34.387981 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:32Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:34.464260 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 req-8a6a920c-c1fc-4143-a526-c3080f458638 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.2676392 Nov 24 16:05:34.522624 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:34.528485 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aac948cb-b62b-4448-b4b8-238e0c605e95 None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:32Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:34.550876 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Router 4579744e-a72c-42e1-b184-5969c9b2caec has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:05:34.551749 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=691eb29c-951c-4f72-b283-76d5f14e961e,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:34.577770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.803311 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:34.803924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.806054 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] 10.222.0.71 "PUT /v2.0/ports/691eb29c-951c-4f72-b283-76d5f14e961e HTTP/1.1" status: 200 len: 1093 time: 3.9674368 Nov 24 16:05:34.810206 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:34.824894 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.964251 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:34.987205 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c13124-c747-44b6-9fcb-dcf35bc63b2a service neutron] Pushing event updated for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:35.009177 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-120ae9ea-de93-4456-93c2-fd682b6d68c1 req-4775cc73-9ab4-4c6c-8483-5565073893f0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:35.010755 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-120ae9ea-de93-4456-93c2-fd682b6d68c1 req-4775cc73-9ab4-4c6c-8483-5565073893f0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.3309674 Nov 24 16:05:35.124923 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-85af4447-4573-4bc0-8f07-efee70142461 req-3239a9f8-d509-478c-8125-2f03bc3a66e8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 1.3322084 Nov 24 16:05:35.167930 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-120ae9ea-de93-4456-93c2-fd682b6d68c1 req-2150677f-9e4b-4629-9f47-536bc4728239 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1377728 Nov 24 16:05:35.184222 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Allocated IP 172.20.0.4 (282e5dca-255c-487d-a4fd-a70d7293f6b8/2243cd13-32e0-4ca8-9d04-3e463c6c8988/0cc6f513-6305-463b-bb1d-17ec8928f67c) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:35.211438 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroup': ['ID=02cc4580-8087-45ad-aad7-b9f490777df0,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:35.257648 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.264630 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59032) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:35.265753 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-427c2e5b-404c-40c9-9b01-8c8dac29de72 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 3.3188605 Nov 24 16:05:35.270127 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group_rule': {'security_group_id': '02cc4580-8087-45ad-aad7-b9f490777df0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:35.344377 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdd1c330-0536-448f-aa29-03ef4833390e" -d '{"events": [{"name": "network-changed", "server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:35.387433 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.586753 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.629454 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.638009 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.686947 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9dfb4a50-1a92-4767-a19e-c9226f0aaac3,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:35.695059 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.698074 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-aaabceae-614f-4d9f-bc8d-a6f7e19cb28f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4332221 Nov 24 16:05:35.700846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59048) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:35.734281 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group_rule': {'security_group_id': '02cc4580-8087-45ad-aad7-b9f490777df0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:35.772792 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:05:35.791086 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Sync routers for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:05:35.792670 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-12d32c42-c6d8-4c74-8cfd-ed3c1dbb8c52 admin admin] 10.222.0.72 "PUT /v2.0/routers/4579744e-a72c-42e1-b184-5969c9b2caec/add_router_interface HTTP/1.1" status: 200 len: 503 time: 17.0283937 Nov 24 16:05:35.858411 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:35.864046 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:22Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:35.872782 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8440026f-e04b-42d8-b575-16f9776eff9c req-8eb12646-2c65-48d5-9ec2-03c230fde498 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 210 time: 0.0744827 Nov 24 16:05:35.878712 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05c44402-f5d1-4ef2-8b38-103651069d63 x-openstack-request-id: req-05c44402-f5d1-4ef2-8b38-103651069d63 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:35.879263 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:35.879661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-05c44402-f5d1-4ef2-8b38-103651069d63 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:35.881098 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e', 'status': 'completed', 'code': 200} Nov 24 16:05:35.899230 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:35.904617 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.001008 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.024824 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.110021 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3db80bb-3b80-4480-ae68-e042131c11a2,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:36.125390 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.133282 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b813ba93-662e-4987-b513-b349778d7119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4301972 Nov 24 16:05:36.134865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59060) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:36.148870 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:36.177715 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:36.233625 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.240269 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:36.255394 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:36.270712 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:36.271620 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.287302 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.315187 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Pushing event updated for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:36.339128 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-4feb57c8-ce9e-44ea-a5fe-8bc7c76081c0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 7.9085772 Nov 24 16:05:36.409836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.416227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:36.515193 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 req-5115ed49-2277-4d6a-b07a-8bd040b36107 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:36.524561 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:36.525087 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 req-5115ed49-2277-4d6a-b07a-8bd040b36107 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 932 time: 0.1558378 Nov 24 16:05:36.602280 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:36.603853 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:36.610717 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:36.613353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.621957 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:36.623180 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:36.653278 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 req-fb7e48cf-766f-4321-8a00-19f6f70fd823 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1269023 Nov 24 16:05:36.693712 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-4f915ed4-db51-420d-9859-f32e94e67f88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 6.2022274 Nov 24 16:05:36.980529 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c30a2f5a-8b67-4015-bf85-aad19ac790a9 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:37.060354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0280a342-0676-471c-9d19-a4d662d6e186 req-35e28480-9e52-4580-9702-e6ee02e05ed2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:37.075281 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0280a342-0676-471c-9d19-a4d662d6e186 req-35e28480-9e52-4580-9702-e6ee02e05ed2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.2496700 Nov 24 16:05:37.141646 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:26Z', 'revision_number': 4, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'dc2bf933-b2d7-4297-b8f9-05a72735f52c', 'name': '', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'mac_address': 'fa:16:3e:fa:5f:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_interface', 'standard_attr_id': 108, 'fixed_ips': [{'subnet_id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:22Z', 'updated_at': '2021-11-24T16:05:28Z', 'revision_number': 2, 'project_id': '60b309e35e734edbaf96c844838de867', 'subnets': [{'id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:37.144970 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port c30a2f5a-8b67-4015-bf85-aad19ac790a9 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:37.145809 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:37.219957 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Checking router: 4579744e-a72c-42e1-b184-5969c9b2caec for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:05:37.220665 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Updating router 4579744e-a72c-42e1-b184-5969c9b2caec port dc2bf933-b2d7-4297-b8f9-05a72735f52c binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:05:37.290447 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:37.335620 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0280a342-0676-471c-9d19-a4d662d6e186 req-6a11ab5d-f636-4037-905b-5a322aed8d28 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2480319 Nov 24 16:05:37.392807 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Allocated IP 172.27.0.109 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/dbc29241-9b3b-4575-a975-6400c574cbdc) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:37.487097 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-4d05c901-b896-4cff-9518-4360d606b718 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:37.491434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-7b1ecb19-d20d-47ba-895f-c30824c1b8f7 None None] Provisioning complete for port 0cc6f513-6305-463b-bb1d-17ec8928f67c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:37.491809 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7b1ecb19-d20d-47ba-895f-c30824c1b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:37.508532 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-4d05c901-b896-4cff-9518-4360d606b718 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 819 time: 0.5350864 Nov 24 16:05:37.588670 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-f1dee283-e43c-4c79-a629-8a12f3ca7dcd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/quotas/60b309e35e734edbaf96c844838de867 HTTP/1.1" status: 200 len: 375 time: 0.0734854 Nov 24 16:05:37.632817 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-7b1ecb19-d20d-47ba-895f-c30824c1b8f7 None None] Port 0cc6f513-6305-463b-bb1d-17ec8928f67c cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:37.753937 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-6d63ee06-f21f-412a-af9d-cf3447cf753e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1566122 Nov 24 16:05:37.801402 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 req-cdc393d5-3fe0-4315-b14d-e8d17c8758bb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:37.804777 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 req-cdc393d5-3fe0-4315-b14d-e8d17c8758bb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 931 time: 0.1250408 Nov 24 16:05:37.851623 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:37.893812 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:37.906659 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.024063 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3bfbb0-acb0-4365-b6c9-5640055b5147 None None] Pushing event updated for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:38.064617 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 req-74b99c17-c93b-4c1a-9c14-fd6bbb28a6e6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2298307 Nov 24 16:05:38.138142 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-bc97ef9b-30e8-4cb0-ae36-6b127ecbb5f5 service neutron] 10.222.0.72 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3767071 Nov 24 16:05:38.154118 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.359324 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Attempting to bind port dc2bf933-b2d7-4297-b8f9-05a72735f52c on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:38.360602 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Attempting to bind port dc2bf933-b2d7-4297-b8f9-05a72735f52c by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:38.361986 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Attempting to bind port dc2bf933-b2d7-4297-b8f9-05a72735f52c on network df42b516-6753-481b-a21c-74d7dd325e73 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:38.382155 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-097c2261-5b3f-4748-b160-686b0da1d465 service neutron] 10.222.0.72 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2398424 Nov 24 16:05:38.382401 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:38.384387 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Checking segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:38.387131 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.387668 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Bound using segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:38.391096 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Bound port: dc2bf933-b2d7-4297-b8f9-05a72735f52c, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:38.391320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.396739 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=dbc29241-9b3b-4575-a975-6400c574cbdc,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:38.496552 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:38.504850 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:38.508609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:38.521439 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] For port dc2bf933-b2d7-4297-b8f9-05a72735f52c, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:38.526653 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] For port dc2bf933-b2d7-4297-b8f9-05a72735f52c, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc2bf933-b2d7-4297-b8f9-05a72735f52c,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:38.532940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.605519 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.619868 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:05:38.620884 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:22Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:38.626827 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faed51b9-df9e-494b-9de7-b95802df1076 req-0968e59a-1a53-4b90-9c59-df53dfea7d2b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:38.629553 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-faed51b9-df9e-494b-9de7-b95802df1076 req-0968e59a-1a53-4b90-9c59-df53dfea7d2b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 932 time: 0.2364328 Nov 24 16:05:38.735442 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871e1bda-a231-46b2-995f-300c7f17343e req-54b51140-8fed-4ac3-b82b-ff64907ad64d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:38.744324 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-871e1bda-a231-46b2-995f-300c7f17343e req-54b51140-8fed-4ac3-b82b-ff64907ad64d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.0919592 Nov 24 16:05:38.768636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:38.825260 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-871e1bda-a231-46b2-995f-300c7f17343e req-7cd7af74-e7db-4cec-91bc-b8eaeb137f20 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798862 Nov 24 16:05:38.926399 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-faed51b9-df9e-494b-9de7-b95802df1076 req-c79819e9-91cd-4bf7-9ffe-ca02bb7eac4d tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2143133 Nov 24 16:05:38.984898 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e64d047b-433f-4c67-b3f6-e27ac2f64c73 req-1a0990c7-0208-4181-bb3d-9bf366ccc8ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 210 time: 0.1185200 Nov 24 16:05:39.200316 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:39.208711 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:39.267744 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:39.331216 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 req-0545a491-0c7d-4b1e-9378-8d01f8ae45d8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:39.346453 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 req-0545a491-0c7d-4b1e-9378-8d01f8ae45d8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 931 time: 0.1316531 Nov 24 16:05:39.357443 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3bfbb0-acb0-4365-b6c9-5640055b5147 None None] Pushing event updated for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:39.471139 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:05:39.542539 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 req-02bfcc07-396c-4966-ad58-043d04b97f3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1946309 Nov 24 16:05:39.565213 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:39.566807 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.4290581 Nov 24 16:05:39.583383 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d35732-1c12-4b8c-a434-a18d4cc9c8d8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=dbc29241-9b3b-4575-a975-6400c574cbdc,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:40.190964 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-d6b771bf-d138-4208-ab58-573acd4a7958 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--722220740&fields=id&tenant_id=1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 267 time: 0.1770854 Nov 24 16:05:40.196055 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-a6c47327-40a4-430b-9c4f-c3b7d8b9b3e3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:40.200320 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-a6c47327-40a4-430b-9c4f-c3b7d8b9b3e3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 819 time: 0.8780129 Nov 24 16:05:40.214220 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:26Z', 'revision_number': 4, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'dc2bf933-b2d7-4297-b8f9-05a72735f52c', 'name': '', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'mac_address': 'fa:16:3e:fa:5f:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_interface', 'standard_attr_id': 108, 'fixed_ips': [{'subnet_id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:22Z', 'updated_at': '2021-11-24T16:05:38Z', 'revision_number': 4, 'project_id': '60b309e35e734edbaf96c844838de867', 'subnets': [{'id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:05:40.267739 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2e7b3502-4037-41f3-9f16-5326d169a6bc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/quotas/60b309e35e734edbaf96c844838de867 HTTP/1.1" status: 200 len: 375 time: 0.0330427 Nov 24 16:05:40.306395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b016db-174a-40b7-b413-36a7afa4dc58 None None] The sync data for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi is: [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:05:26Z', 'revision_number': 4, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'dc2bf933-b2d7-4297-b8f9-05a72735f52c', 'name': '', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'mac_address': 'fa:16:3e:fa:5f:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_interface', 'standard_attr_id': 108, 'fixed_ips': [{'subnet_id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:22Z', 'updated_at': '2021-11-24T16:05:38Z', 'revision_number': 4, 'project_id': '60b309e35e734edbaf96c844838de867', 'subnets': [{'id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:05:40.565110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-05d3060f-989c-4e67-84c7-f0ad46d41b41 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2857847 Nov 24 16:05:40.571051 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-2e33d782-0838-4bb1-ada4-5f8f18e30464 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:40.572714 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-2e33d782-0838-4bb1-ada4-5f8f18e30464 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 811 time: 0.3792582 Nov 24 16:05:40.619289 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-d323f677-df72-44b8-bdeb-0d98e5ef9e87 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/quotas/1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 375 time: 0.0391150 Nov 24 16:05:40.729237 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-660686e7-101d-4d51-a17b-f0a95bfcc933 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0988066 Nov 24 16:05:40.854884 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc2bf933-b2d7-4297-b8f9-05a72735f52c up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:40.970434 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-97d80038-82ab-46c5-8870-10f3bef2b58a service neutron] 10.222.0.72 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2260482 Nov 24 16:05:41.051402 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-34e3e230-8c7e-4f1e-a584-9dba2c1524bf service neutron] 10.222.0.72 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4726982 Nov 24 16:05:41.136310 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port dc2bf933-b2d7-4297-b8f9-05a72735f52c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:41.137403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:41.245961 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7626c5b4-7f01-4e73-9593-a41a39dfbca5 service neutron] 10.222.0.72 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2741749 Nov 24 16:05:41.379748 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Request body: {'port': {'device_id': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:41.440453 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Request body: {'port': {'device_id': '4070b904-d207-48f3-b522-209d11d5291c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:41.507118 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-79cb0534-f1b7-449d-87df-239ee0103523 service neutron] 10.222.0.72 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4280171 Nov 24 16:05:41.511196 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:41.701924 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port dc2bf933-b2d7-4297-b8f9-05a72735f52c, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc2bf933-b2d7-4297-b8f9-05a72735f52c,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:41.741353 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:41.871025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd1c330-0536-448f-aa29-03ef4833390e req-c6271839-2370-4643-90ba-5a6c4eb24f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:41.874832 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fdd1c330-0536-448f-aa29-03ef4833390e req-c6271839-2370-4643-90ba-5a6c4eb24f5f service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 1096 time: 0.3773046 Nov 24 16:05:41.967459 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:42.448114 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:42.526279 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e09b15a-3564-4637-84ee-df7bc36f9cff req-49aef998-9422-47fc-b898-e7aacc72debc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:42.535567 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2e09b15a-3564-4637-84ee-df7bc36f9cff req-49aef998-9422-47fc-b898-e7aacc72debc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 932 time: 0.3743660 Nov 24 16:05:42.551998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd1c330-0536-448f-aa29-03ef4833390e req-9b636ff0-57e6-47d9-9b03-d684aca19b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:42.553635 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fdd1c330-0536-448f-aa29-03ef4833390e req-9b636ff0-57e6-47d9-9b03-d684aca19b83 service neutron] 10.222.0.71 "GET /v2.0/networks?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&shared=False HTTP/1.1" status: 200 len: 917 time: 0.6411183 Nov 24 16:05:42.562420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220e547e-f997-46cd-a20e-5ba10c8b442a req-6036e7ba-a18f-4680-bf71-9b165dd00552 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:42.577792 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-220e547e-f997-46cd-a20e-5ba10c8b442a req-6036e7ba-a18f-4680-bf71-9b165dd00552 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.7631252 Nov 24 16:05:42.582776 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:42.598397 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc2bf933-b2d7-4297-b8f9-05a72735f52c up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:42.735434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port dc2bf933-b2d7-4297-b8f9-05a72735f52c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:42.736089 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:42.842597 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2e09b15a-3564-4637-84ee-df7bc36f9cff req-aff4e49f-6197-462b-bce9-b29b478f0d43 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3049419 Nov 24 16:05:43.013902 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.71', 55185) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:43.315132 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-220e547e-f997-46cd-a20e-5ba10c8b442a req-023bc418-6620-40e7-a633-feb374ca71cc tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7360632 Nov 24 16:05:43.486968 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c req-7a525beb-86cd-4ee6-9759-2e067e5c7898 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:43.496673 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c req-7a525beb-86cd-4ee6-9759-2e067e5c7898 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 931 time: 0.3718133 Nov 24 16:05:43.614436 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd1c330-0536-448f-aa29-03ef4833390e req-0d89442d-6f49-49a8-9d9b-646007335e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:43.622049 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fdd1c330-0536-448f-aa29-03ef4833390e req-0d89442d-6f49-49a8-9d9b-646007335e2e service neutron] 10.222.0.71 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 1.0507457 Nov 24 16:05:43.708156 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c req-c1cb50bb-86b9-43ad-91cb-9f0f39429cd4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1783957 Nov 24 16:05:43.787243 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:43.815007 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bfcc84a6-c135-4d5c-a567-63d0810597de req-2ea30d3d-4447-4874-aa9a-05443b606b74 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 210 time: 0.1454091 Nov 24 16:05:43.920608 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-22b7010a-4765-423e-aba9-ef4c6e6e010d req-6d4d2ee6-1ffb-47ab-9bb5-e628cbf22bd9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 210 time: 0.0521545 Nov 24 16:05:44.165606 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-82bf2750-c6f0-4703-9bd2-fbdd8a7a9024 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:44.167314 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-82bf2750-c6f0-4703-9bd2-fbdd8a7a9024 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 819 time: 1.0959427 Nov 24 16:05:44.214411 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6613f960-a177-42c1-a2ce-664f7508dbb6 req-9fd4d230-2de0-4b7f-bb33-15d1fe9021ae tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:44.216048 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6613f960-a177-42c1-a2ce-664f7508dbb6 req-9fd4d230-2de0-4b7f-bb33-15d1fe9021ae tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 932 time: 0.1929224 Nov 24 16:05:44.407127 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6613f960-a177-42c1-a2ce-664f7508dbb6 req-73826161-bec2-4981-af43-77d53896eee3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1317868 Nov 24 16:05:44.500214 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id af829109-ec6d-4b1f-b501-099d680019fe {{(pid=102787) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:44.519282 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:44.527403 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c req-bdf6bdbd-5fd0-46d1-b228-d4c2690e9bd0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:44.528100 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102787) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:44.529729 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c req-bdf6bdbd-5fd0-46d1-b228-d4c2690e9bd0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.0683711 Nov 24 16:05:44.542140 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:44.557269 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.provisioning_blocks [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Transition to ACTIVE for port object af829109-ec6d-4b1f-b501-099d680019fe will not be triggered until provisioned by entity L2. {{(pid=102787) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:44.566603 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:44.570379 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.provisioning_blocks [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Transition to ACTIVE for port object 0cc6f513-6305-463b-bb1d-17ec8928f67c will not be triggered until provisioned by entity L2. {{(pid=102787) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:44.598344 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:44.609991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c req-81b93673-2481-44ea-83c2-19cb4b2e6478 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658665 Nov 24 16:05:44.689159 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Request body: {'port': {'device_id': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'admin_state_up': True, 'tenant_id': '60b309e35e734edbaf96c844838de867'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:44.694757 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Pushing event updated for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:44.713808 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59316) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:44.733555 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-fd1cc616-31ea-4259-92e1-7e996222af94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:44.735061 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-fd1cc616-31ea-4259-92e1-7e996222af94 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 1096 time: 0.0767989 Nov 24 16:05:44.782682 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Attempting to bind port af829109-ec6d-4b1f-b501-099d680019fe on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:44.783056 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Attempting to bind port af829109-ec6d-4b1f-b501-099d680019fe by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': 'cfd8620d-0436-44f1-9416-05a3b74c08b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1036, 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7'}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:44.783437 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Attempting to bind port af829109-ec6d-4b1f-b501-099d680019fe on network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:44.854434 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Port af829109-ec6d-4b1f-b501-099d680019fe on network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:44.855106 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Attempting to bind port af829109-ec6d-4b1f-b501-099d680019fe on network 3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:44.869953 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Attempting to bind port 0cc6f513-6305-463b-bb1d-17ec8928f67c on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:44.870300 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Attempting to bind port 0cc6f513-6305-463b-bb1d-17ec8928f67c by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:44.870638 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Attempting to bind port 0cc6f513-6305-463b-bb1d-17ec8928f67c on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:44.878459 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:44.922788 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Port 0cc6f513-6305-463b-bb1d-17ec8928f67c on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:44.923121 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Attempting to bind port 0cc6f513-6305-463b-bb1d-17ec8928f67c on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:44.925354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:44.925716 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Checking segment: {'id': 'cfd8620d-0436-44f1-9416-05a3b74c08b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1036, 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:44.926288 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Bound using segment: {'id': 'cfd8620d-0436-44f1-9416-05a3b74c08b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1036, 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7'} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:44.926738 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Bound port: af829109-ec6d-4b1f-b501-099d680019fe, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cfd8620d-0436-44f1-9416-05a3b74c08b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1036, 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7'}}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:44.927105 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:44.949557 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-ab8d083a-0d19-41fa-ba86-a59df56b5492 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=691eb29c-951c-4f72-b283-76d5f14e961e HTTP/1.1" status: 200 len: 217 time: 0.1456709 Nov 24 16:05:44.957519 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:44.958068 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Checking segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:44.958191 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Bound using segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:44.958552 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Bound port: 0cc6f513-6305-463b-bb1d-17ec8928f67c, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:44.958917 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.037111 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04892861-3789-40b6-9236-5c301fd0b315 req-897da658-1701-4d13-bdfd-8e1a4064225d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:45.044770 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-04892861-3789-40b6-9236-5c301fd0b315 req-897da658-1701-4d13-bdfd-8e1a4064225d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.2027075 Nov 24 16:05:45.049346 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e8910a6-c1cd-40ea-b737-9e566c122334 req-b5444fab-faf7-4df0-9c9c-e8c001c304af tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 210 time: 0.1047916 Nov 24 16:05:45.093729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b89f6edf-6a8d-41a5-9dfc-d48a82563092 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.096912 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43318515-929e-4bec-a425-0fd4cac44f1d req-28142050-3b1c-48fd-936d-cad884d3e7a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:45.098851 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-28142050-3b1c-48fd-936d-cad884d3e7a9 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.1367314 Nov 24 16:05:45.175157 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-92bd8948-ba73-48c4-8b01-f499d9d158d9 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0682142 Nov 24 16:05:45.182207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.71', 55194) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:45.199460 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Made reservation on behalf of 60b309e35e734edbaf96c844838de867 for: {'port': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:45.214247 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.336166 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, cleared binding levels {{(pid=102787) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:45.340331 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, cleared binding levels {{(pid=102787) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:45.373352 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a req-de1fcf37-8ab9-4dfc-bd83-efe80ae36db9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 210 time: 0.1496959 Nov 24 16:05:45.398014 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=af829109-ec6d-4b1f-b501-099d680019fe,segment=NetworkSegment(cfd8620d-0436-44f1-9416-05a3b74c08b2),segment_id=cfd8620d-0436-44f1-9416-05a3b74c08b2)] {{(pid=102787) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:45.400718 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102787) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:45.412377 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-04892861-3789-40b6-9236-5c301fd0b315 req-6a5e7615-fb80-4263-8930-20b1e46acca1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3663723 Nov 24 16:05:45.443822 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.459015 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.554374 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:45.555146 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.556732 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] 10.222.0.71 "PUT /v2.0/ports/af829109-ec6d-4b1f-b501-099d680019fe HTTP/1.1" status: 200 len: 1094 time: 4.1461132 Nov 24 16:05:45.561744 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:45.686608 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:45.686608 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.686608 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] 10.222.0.71 "PUT /v2.0/ports/0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 1093 time: 4.3119848 Nov 24 16:05:45.694763 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b89f6edf-6a8d-41a5-9dfc-d48a82563092 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.736095 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-d8a930a4-9bcb-4700-9d4c-ba5e62556d35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:45.736095 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-d8a930a4-9bcb-4700-9d4c-ba5e62556d35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 811 time: 0.5510252 Nov 24 16:05:45.915550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b89f6edf-6a8d-41a5-9dfc-d48a82563092 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:45.923088 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.71', 55200) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:45.966137 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-7d501639-4bf8-48d7-9b46-69ecf0b5d855 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7623701 Nov 24 16:05:46.146476 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52a95548-2bc3-4ded-84d0-c998a4766e48" -d '{"events": [{"name": "network-changed", "server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:46.193765 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d507daf-75a1-4057-a997-21deab8ed3cf service neutron] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=3']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:46.273135 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Allocated IP 172.20.0.8 (df42b516-6753-481b-a21c-74d7dd325e73/e60a04ed-2a73-4097-a8e3-582d7b1a8d1f/533d257a-8aad-4722-8f01-84015f80cdd5) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:46.288865 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c26872f1-6602-4903-853c-72320c009c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.290413 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c26872f1-6602-4903-853c-72320c009c96 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=c127095ad8cc41098ef0dd79f4fcd589&device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 1097 time: 0.6148107 Nov 24 16:05:46.308060 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-eb64a01b-1b36-4a53-ba63-5aad94b61738 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.310011 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-eb64a01b-1b36-4a53-ba63-5aad94b61738 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1096 time: 0.4824803 Nov 24 16:05:46.336113 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b89f6edf-6a8d-41a5-9dfc-d48a82563092 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e6579042dda34bee9a0de8d43c5aa93f&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6183817 Nov 24 16:05:46.342296 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5416e730-990d-4757-b68b-4822bf4dc108 req-451da688-0520-4a72-8189-60ce7c222c0e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.343917 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5416e730-990d-4757-b68b-4822bf4dc108 req-451da688-0520-4a72-8189-60ce7c222c0e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 944 time: 0.6064191 Nov 24 16:05:46.351145 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59386) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:46.359510 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-2a8fc0b1-f313-4e6e-8225-47ca0ff4fbb3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 379 time: 0.4834154 Nov 24 16:05:46.374189 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a req-4e307a28-4e02-4f36-bfea-6e4ef29155e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.375759 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a req-4e307a28-4e02-4f36-bfea-6e4ef29155e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.5497985 Nov 24 16:05:46.385396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'port': {'device_id': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'admin_state_up': True, 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'security_groups': ['02cc4580-8087-45ad-aad7-b9f490777df0']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:46.442516 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89f6edf-6a8d-41a5-9dfc-d48a82563092 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e632a0e-adce-45b6-9f09-94ec6e5da193,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:46.455544 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-02d9185f-4477-4306-95bb-38da2dd4f650 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=af829109-ec6d-4b1f-b501-099d680019fe HTTP/1.1" status: 200 len: 217 time: 0.1520088 Nov 24 16:05:46.468232 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e5a687-7a5e-4a23-b9ab-92a11ed94d82 service neutron] Pushing event updated for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=3']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:46.469285 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-ca8f407a-c373-40ed-939d-da6aa7ed4e5e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.470813 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-ca8f407a-c373-40ed-939d-da6aa7ed4e5e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 819 time: 0.5314422 Nov 24 16:05:46.475971 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-486f13a9-6a94-4de9-a98f-908fc8a57c30 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 217 time: 0.1460474 Nov 24 16:05:46.501986 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Request body: {'port': {'device_id': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'admin_state_up': True, 'tenant_id': '60b309e35e734edbaf96c844838de867'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:46.624402 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-ba175ffa-c3be-41f7-9f7d-6cbc5ede15e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.626611 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-ba175ffa-c3be-41f7-9f7d-6cbc5ede15e7 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=73ce2b53-9439-498a-9f86-2224119f5b5b HTTP/1.1" status: 200 len: 851 time: 0.1525214 Nov 24 16:05:46.661707 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-1864b518-bd80-4d21-9020-141822615a18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.663289 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-1864b518-bd80-4d21-9020-141822615a18 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.1675436 Nov 24 16:05:46.665105 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-497c64b0-5d7c-466a-9711-ac237bb6fda7 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4173834 Nov 24 16:05:46.675380 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5416e730-990d-4757-b68b-4822bf4dc108 req-48a45bab-9310-44e0-9e64-5f160152e380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3059020 Nov 24 16:05:46.695604 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:46.696716 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a req-4443395b-f013-4cd7-973d-117841822baa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2815404 Nov 24 16:05:46.728174 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-3cfb32a2-1ea6-4303-bf2e-30a6f8556c93 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0810690 Nov 24 16:05:46.784937 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:46.835416 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Made reservation on behalf of 1c341b845ae6468b847beba4eee796dd for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:46.842061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:46.913002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Made reservation on behalf of 60b309e35e734edbaf96c844838de867 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:05:46.916950 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:46.991890 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-943a4116-8aa8-4319-82dc-70a87f5f028d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:46.993513 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-943a4116-8aa8-4319-82dc-70a87f5f028d service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2792559 Nov 24 16:05:47.001283 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.011830 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.017355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.033155 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9e632a0e-adce-45b6-9f09-94ec6e5da193 HTTP/1.1" status: 204 len: 168 time: 0.6640835 Nov 24 16:05:47.056797 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 x-openstack-request-id: req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:47.057250 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "tag": "af829109-ec6d-4b1f-b501-099d680019fe", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:47.057394 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:47.057880 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe', 'status': 'completed', 'code': 200} Nov 24 16:05:47.063825 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-c7c73e21-ca3f-46e2-b0b0-6ac7e66fdfc6 service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2645617 Nov 24 16:05:47.221842 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda24acc-b55d-4cf8-9cc4-2ca64f672352 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e632a0e-adce-45b6-9f09-94ec6e5da193,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:47.223031 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.261796 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 req-5f98c48d-9ffd-4fad-b564-52e8ffebc12f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 210 time: 0.1653397 Nov 24 16:05:47.268891 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f62adfd4-f93f-4829-9a3d-8296751b0495 req-15ccf61f-465e-43b7-b0ba-63a7a7c043e4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 210 time: 0.0626698 Nov 24 16:05:47.314764 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-8dc67140-2385-4c02-9b62-333d2e576579 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3095372 Nov 24 16:05:47.368648 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea req-5fc7311d-2504-4f71-b0b4-5d8711d21202 service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2701507 Nov 24 16:05:47.374998 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Network df42b516-6753-481b-a21c-74d7dd325e73 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:47.387128 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:47.392335 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Pushing event updated for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:47.412659 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:47.426591 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:47.431424 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.479472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Allocated IP 172.20.0.2 (df42b516-6753-481b-a21c-74d7dd325e73/e60a04ed-2a73-4097-a8e3-582d7b1a8d1f/a424f220-1812-4f50-ab01-68a1923ec96d) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:47.512652 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Allocated IP 172.20.0.9 (d785b693-1522-4c61-9c47-37993ec7d517/6f721a8b-2f8a-4509-b0fb-4eea2f82fd87/1c836e44-a6b1-400d-a64b-3d1e5a65fd29) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:05:47.545917 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 req-462b9801-d4d3-4265-b64e-d7d754543cd7 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2161822 Nov 24 16:05:47.688527 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-057c9568-8eb9-4e03-98ab-d899c55837db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0057373 Nov 24 16:05:47.725108 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Request body: {'port': {'device_id': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:47.737148 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59430) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:47.818236 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eb6b9f94-01a9-4e2c-8331-b7f73c26aa79 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.831896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5170efab-fa06-4b07-ba54-d7882b932ebf req-6205cc2c-941f-4ee1-b0da-acebc8986122 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:47.833589 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5170efab-fa06-4b07-ba54-d7882b932ebf req-6205cc2c-941f-4ee1-b0da-acebc8986122 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.4442177 Nov 24 16:05:47.849745 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-78288284-4b80-4519-8443-2b6a71a8834c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:47.851315 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-78288284-4b80-4519-8443-2b6a71a8834c service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=c127095ad8cc41098ef0dd79f4fcd589&device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 1097 time: 0.2987218 Nov 24 16:05:47.885073 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.923436 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.951553 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:47.983994 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0124571-d319-4930-8c5e-60654eee6486 req-c8464898-80ea-497f-9b2f-e0f1b4722609 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:47.985844 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d0124571-d319-4930-8c5e-60654eee6486 req-c8464898-80ea-497f-9b2f-e0f1b4722609 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.1199036 Nov 24 16:05:48.003901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.021630 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59440) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:48.045391 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.096384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Network df42b516-6753-481b-a21c-74d7dd325e73 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:48.120477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:48.124352 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:48.130661 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5170efab-fa06-4b07-ba54-d7882b932ebf req-bc086b3d-aca9-40f9-9c2b-f056af2d3c01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2628911 Nov 24 16:05:48.133694 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.134473 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.163154 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Network d785b693-1522-4c61-9c47-37993ec7d517 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:05:48.171862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Pushing event updated for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:48.182702 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:05:48.184938 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-4642ab76-cc10-4a4b-8387-9c5f7dfc8f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.186354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:05:48.186591 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-4642ab76-cc10-4a4b-8387-9c5f7dfc8f5f service neutron] 10.222.0.71 "GET /v2.0/networks?id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 HTTP/1.1" status: 200 len: 913 time: 0.3160505 Nov 24 16:05:48.193289 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.194033 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.211105 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5f728895-6071-48a7-9bbb-2311e108a22e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7150087 Nov 24 16:05:48.238397 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d0124571-d319-4930-8c5e-60654eee6486 req-6eb787bf-bb5e-4bc1-8b0c-581d6e16f667 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2384672 Nov 24 16:05:48.268414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Request body: {'port': {'device_id': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:48.301913 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9218891 Nov 24 16:05:48.326952 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Request body: {'port': {'device_id': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:05:48.332617 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7b1f18-d4ea-4b7b-b124-dac49ee5f2f7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:48.349127 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-b6eeae5e-8069-4a71-91dd-ea8bd91a8bec service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=af829109-ec6d-4b1f-b501-099d680019fe HTTP/1.1" status: 200 len: 217 time: 0.1538751 Nov 24 16:05:48.367156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-05de9c68-7748-4acd-b23f-d922fc54c420 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.375588 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eb6b9f94-01a9-4e2c-8331-b7f73c26aa79 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.448358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.555382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.606403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-86855638-bbf2-42d7-8217-7adc075fe6a2 None None] Provisioning complete for port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:48.607945 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-86855638-bbf2-42d7-8217-7adc075fe6a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.611427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8b9894ec-f43a-47d8-b1d3-05fe83314b1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.614491 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eb6b9f94-01a9-4e2c-8331-b7f73c26aa79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.616452 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 req-2e4dd55a-454d-436d-8ffe-de54d7270fa0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.618050 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 req-2e4dd55a-454d-436d-8ffe-de54d7270fa0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 931 time: 0.1984563 Nov 24 16:05:48.652764 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-86855638-bbf2-42d7-8217-7adc075fe6a2 None None] Port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:05:48.753213 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-eb6b9f94-01a9-4e2c-8331-b7f73c26aa79 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e9340a9c139643f09197eccb1de771f6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0138748 Nov 24 16:05:48.759369 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6b9f94-01a9-4e2c-8331-b7f73c26aa79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b31d7d56-3513-4b28-8db1-43ed2cb39aad,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:48.764742 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59448) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:48.766275 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-c72b274f-0eb2-45f1-893a-46ec5c48f214 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.770999 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-c72b274f-0eb2-45f1-893a-46ec5c48f214 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=73ce2b53-9439-498a-9f86-2224119f5b5b HTTP/1.1" status: 200 len: 851 time: 0.4051261 Nov 24 16:05:48.796901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-05de9c68-7748-4acd-b23f-d922fc54c420 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.807256 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-05de9c68-7748-4acd-b23f-d922fc54c420 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:48.831775 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-8d4b532c-fa9d-464d-befb-f0744c540d12 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0530779 Nov 24 16:05:48.853565 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 req-0f34508c-ffe2-4c58-8b75-5cd88753a724 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:48.855851 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 req-0f34508c-ffe2-4c58-8b75-5cd88753a724 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 944 time: 0.2374063 Nov 24 16:05:48.861673 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 req-19e41f9d-4cfe-4eea-a69e-f877f9cdbcc1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2348697 Nov 24 16:05:48.923681 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-05de9c68-7748-4acd-b23f-d922fc54c420 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a6f81a65731a467f8cf45f4603355cfe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8974712 Nov 24 16:05:48.929297 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59456) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:48.941324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05de9c68-7748-4acd-b23f-d922fc54c420 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9809e5b-7760-4a09-868f-322f5c6cb3f8,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:48.987814 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 req-8d873889-5682-4534-a33a-eaef5f5fb12c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153100 Nov 24 16:05:49.040348 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.064808 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:49.067270 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35232e85-7176-4963-8307-3cf7fcd89eca" -d '{"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:49.120959 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.124455 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.159857 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 533d257a-8aad-4722-8f01-84015f80cdd5 {{(pid=102787) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:49.171848 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce3a5b6-569d-494e-b075-c73c8a240526 req-e9b9c2bd-1fdc-41ca-82c2-e4e3d675b8ea tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:49.174040 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ce3a5b6-569d-494e-b075-c73c8a240526 req-e9b9c2bd-1fdc-41ca-82c2-e4e3d675b8ea tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 931 time: 0.1892447 Nov 24 16:05:49.177078 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.182508 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1589737a-5a70-466f-9782-e3bd1eb728ea x-openstack-request-id: req-1589737a-5a70-466f-9782-e3bd1eb728ea {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:49.183616 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:49.184207 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-1589737a-5a70-466f-9782-e3bd1eb728ea {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:49.185514 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'status': 'completed', 'code': 200} Nov 24 16:05:49.191935 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.204876 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-91acb7c8-5740-49e1-8f5f-c0439cf641da service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3594897 Nov 24 16:05:49.275259 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.provisioning_blocks [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Transition to ACTIVE for port object 533d257a-8aad-4722-8f01-84015f80cdd5 will not be triggered until provisioned by entity L2. {{(pid=102787) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:49.295804 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.408228 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35232e85-7176-4963-8307-3cf7fcd89eca req-8323f166-02e5-4de3-990c-12b19a9fa338 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:49.409946 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-8323f166-02e5-4de3-990c-12b19a9fa338 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1096 time: 0.2153814 Nov 24 16:05:49.438218 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.442951 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.458524 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b31d7d56-3513-4b28-8db1-43ed2cb39aad HTTP/1.1" status: 204 len: 168 time: 0.6893685 Nov 24 16:05:49.502419 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Pushing event updated for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:49.573992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:49.588049 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.590979 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70851cc6-ce81-428a-ba58-61f4863631fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b31d7d56-3513-4b28-8db1-43ed2cb39aad,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:49.631315 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ce3a5b6-569d-494e-b075-c73c8a240526 req-1217e66e-fb5c-4927-a0b4-b78456daed02 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4429972 Nov 24 16:05:49.660320 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Transition to ACTIVE for port object 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:49.661894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.663670 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-4f71ab65-143d-44a7-9e31-92e96f180aa7 service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4252453 Nov 24 16:05:49.665950 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.667227 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c9809e5b-7760-4a09-868f-322f5c6cb3f8 HTTP/1.1" status: 204 len: 168 time: 0.7360954 Nov 24 16:05:49.680426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.692174 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Attempting to bind port 533d257a-8aad-4722-8f01-84015f80cdd5 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:49.704585 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Attempting to bind port 533d257a-8aad-4722-8f01-84015f80cdd5 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:49.705151 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Attempting to bind port 533d257a-8aad-4722-8f01-84015f80cdd5 on network df42b516-6753-481b-a21c-74d7dd325e73 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:49.728051 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07da9b5b-e434-4658-b557-fe545f8889f3 req-a20b3c6c-1973-4adb-bf4f-3116984a139f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:49.734549 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2db350-defa-4f69-ac83-0099a0eb16b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9809e5b-7760-4a09-868f-322f5c6cb3f8,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:49.743825 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-07da9b5b-e434-4658-b557-fe545f8889f3 req-a20b3c6c-1973-4adb-bf4f-3116984a139f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.3294790 Nov 24 16:05:49.802910 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Pushing event updated for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:49.816773 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Port 533d257a-8aad-4722-8f01-84015f80cdd5 on network df42b516-6753-481b-a21c-74d7dd325e73 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:49.817125 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Attempting to bind port 533d257a-8aad-4722-8f01-84015f80cdd5 on network df42b516-6753-481b-a21c-74d7dd325e73 {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:49.832443 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:49.832815 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Checking segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:49.833411 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Bound using segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} {{(pid=102787) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:49.833899 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.managers [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Bound port: 533d257a-8aad-4722-8f01-84015f80cdd5, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}}] {{(pid=102787) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:49.834247 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.839536 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35232e85-7176-4963-8307-3cf7fcd89eca req-47749a2c-f122-4b9d-8b5d-fcdacb795efb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:49.841064 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-47749a2c-f122-4b9d-8b5d-fcdacb795efb service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.4169230 Nov 24 16:05:49.926835 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-7a821e43-f6fb-4b9e-8dc5-9e141ddd8670 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 217 time: 0.0760889 Nov 24 16:05:49.939646 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Attempting to bind port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:49.940336 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Attempting to bind port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:49.940687 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Attempting to bind port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:49.956322 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 on network d785b693-1522-4c61-9c47-37993ec7d517 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:49.956661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Attempting to bind port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:49.965465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a424f220-1812-4f50-ab01-68a1923ec96d {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:49.982365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:49.982365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Checking segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:49.982365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Bound using segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:49.982365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Bound port: 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:49.982365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:49.987040 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.010786 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d476565-0053-4668-8a70-5a6148bef0dd req-70509bcd-2699-421e-9c3f-a3d21cf334e5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.012490 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d476565-0053-4668-8a70-5a6148bef0dd req-70509bcd-2699-421e-9c3f-a3d21cf334e5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.2211962 Nov 24 16:05:50.026874 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Transition to ACTIVE for port object a424f220-1812-4f50-ab01-68a1923ec96d will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:05:50.030927 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-07da9b5b-e434-4658-b557-fe545f8889f3 req-d6236d48-ce27-491e-8321-fa135445566e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2860842 Nov 24 16:05:50.037247 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.101638 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35232e85-7176-4963-8307-3cf7fcd89eca req-e2d12ada-ba1e-47b8-9990-2d947b1455b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.103086 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-e2d12ada-ba1e-47b8-9990-2d947b1455b6 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.1405942 Nov 24 16:05:50.156635 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, cleared binding levels {{(pid=102787) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:50.162388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=533d257a-8aad-4722-8f01-84015f80cdd5,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102787) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:50.222248 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d476565-0053-4668-8a70-5a6148bef0dd req-d22b62a3-6947-4356-a5a2-8621e223d50d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1976869 Nov 24 16:05:50.222920 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Pushing event updated for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:50.229921 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:50.248484 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.252681 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:50.254985 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Attempting to bind port a424f220-1812-4f50-ab01-68a1923ec96d on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:05:50.255879 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Attempting to bind port a424f220-1812-4f50-ab01-68a1923ec96d by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:05:50.256022 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Attempting to bind port a424f220-1812-4f50-ab01-68a1923ec96d on network df42b516-6753-481b-a21c-74d7dd325e73 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:50.261640 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.276156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Port a424f220-1812-4f50-ab01-68a1923ec96d on network df42b516-6753-481b-a21c-74d7dd325e73 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:05:50.276580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Attempting to bind port a424f220-1812-4f50-ab01-68a1923ec96d on network df42b516-6753-481b-a21c-74d7dd325e73 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:05:50.317637 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.318385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.320546 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-394df725-6751-46d4-9390-eaf7163b115d service neutron] 10.222.0.71 "PUT /v2.0/ports/1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 1093 time: 2.0067635 Nov 24 16:05:50.323999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:50.338836 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa9478d7-7666-481d-9362-da95c35c7e51" -d '{"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:50.349738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 5, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:05:50.349738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Checking segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:05:50.349738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Bound using segment: {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:05:50.349738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Bound port: a424f220-1812-4f50-ab01-68a1923ec96d, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1035, 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:05:50.351191 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.365963 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.366581 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.368068 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] 10.222.0.71 "PUT /v2.0/ports/533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 1093 time: 2.6615961 Nov 24 16:05:50.445667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59492) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:50.449438 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35232e85-7176-4963-8307-3cf7fcd89eca req-b9e6eaf3-5975-4377-b851-91517a1a4225 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.455152 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-b9e6eaf3-5975-4377-b851-91517a1a4225 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3344870 Nov 24 16:05:50.494567 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0a013e-3c4d-4870-b03a-16a3c4dff94b service neutron] Pushing event updated for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=3']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:50.520762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394df725-6751-46d4-9390-eaf7163b115d service neutron] Pushing event updated for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:50.546164 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-87a59382-efd0-439d-8d0d-7923b46d1951 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.547583 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 req-435915b9-1a3d-40b2-bd52-96b2458f4ddd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.550001 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 req-435915b9-1a3d-40b2-bd52-96b2458f4ddd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.3396921 Nov 24 16:05:50.564722 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-aa0c9aaa-eaac-481c-9050-52649a269374 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.566325 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-aa0c9aaa-eaac-481c-9050-52649a269374 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1096 time: 0.1803076 Nov 24 16:05:50.651658 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-f65d2456-a796-4bed-9998-2db22cd8aed2 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 217 time: 0.0736935 Nov 24 16:05:50.655172 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:05:50.666121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a req-9ada3a24-daff-4029-aa20-0fa7d7768708 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.668023 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a req-9ada3a24-daff-4029-aa20-0fa7d7768708 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 944 time: 0.2422032 Nov 24 16:05:50.689836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-260d5363-9246-4683-816e-bd902445bc54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.691366 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-260d5363-9246-4683-816e-bd902445bc54 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1096 time: 0.2524045 Nov 24 16:05:50.778411 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-044a6734-0847-4481-b666-07302415d682 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.0472100 Nov 24 16:05:50.803200 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 req-c616f961-2231-4513-8c15-2d3c27230aeb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2299352 Nov 24 16:05:50.811608 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-e7b3d573-ee30-4ef0-b649-82ae68ded20e service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3304856 Nov 24 16:05:50.812922 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a424f220-1812-4f50-ab01-68a1923ec96d,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:05:50.863718 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-87a59382-efd0-439d-8d0d-7923b46d1951 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.879396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.907200 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-87a59382-efd0-439d-8d0d-7923b46d1951 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.956004 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-d14600c1-35df-4f9d-a502-c729cfbfb51f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.960474 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-d14600c1-35df-4f9d-a502-c729cfbfb51f service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.1529086 Nov 24 16:05:50.979164 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:50.981618 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:50.983216 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] 10.222.0.71 "PUT /v2.0/ports/a424f220-1812-4f50-ab01-68a1923ec96d HTTP/1.1" status: 200 len: 1093 time: 2.7380650 Nov 24 16:05:50.988762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 x-openstack-request-id: req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:50.989215 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:50.990496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:50.991138 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'status': 'completed', 'code': 200} Nov 24 16:05:51.002911 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-260db5db-86d4-4589-ac67-0c79553df754 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0322380 Nov 24 16:05:51.116649 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-aadd504f-de14-484e-9379-1f0ee2b0e657 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.118669 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-aadd504f-de14-484e-9379-1f0ee2b0e657 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.4444249 Nov 24 16:05:51.120801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a59382-efd0-439d-8d0d-7923b46d1951 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b877f036-0e42-4437-8aa5-f61bf71658d4,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:51.132674 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-12483211-1225-4ae2-98a5-5570b442db9e service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1165555 Nov 24 16:05:51.171415 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-9ea94bf5-518e-406c-a16b-aa86dcf10bfe service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3476894 Nov 24 16:05:51.173451 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7e0d09-3913-4ae3-b6c9-3426f395f98a service neutron] Pushing event updated for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:51.183531 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-87a59382-efd0-439d-8d0d-7923b46d1951 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=89c46e39ff264579817b5e7f69c52a25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7276702 Nov 24 16:05:51.199023 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:51.201845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f" -d '{"events": [{"name": "network-changed", "server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:51.213535 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59516) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:51.239614 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a req-605189b7-a76f-44cf-9706-b071e5070a90 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5564353 Nov 24 16:05:51.262196 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6b18f2f8-c68f-4161-9907-00227195e4cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:51.268025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-60c3cb66-bebc-48d5-bdfe-885ff1601557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.269839 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-60c3cb66-bebc-48d5-bdfe-885ff1601557 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 1096 time: 0.2280107 Nov 24 16:05:51.282840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-ee04db18-9d72-4b06-91c7-242af84e5d27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.284371 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-ee04db18-9d72-4b06-91c7-242af84e5d27 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0973132 Nov 24 16:05:51.349643 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-5ce75f4a-1804-4d67-953f-a100bdaf3e14 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=a424f220-1812-4f50-ab01-68a1923ec96d HTTP/1.1" status: 200 len: 217 time: 0.0692153 Nov 24 16:05:51.484552 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-fc2932d1-a795-45ea-a571-417f87d6cf03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.486349 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-fc2932d1-a795-45ea-a571-417f87d6cf03 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.1297648 Nov 24 16:05:51.528506 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-9de81d20-f475-46b8-85ab-9c221844c7f9 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0346243 Nov 24 16:05:51.530844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 req-1489b6c6-c72f-45a3-9127-38fee269af78 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.532431 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 req-1489b6c6-c72f-45a3-9127-38fee269af78 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.3968682 Nov 24 16:05:51.541882 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 req-943b715e-4137-4595-aecd-761f856e4a1b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.543464 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 req-943b715e-4137-4595-aecd-761f856e4a1b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.1727350 Nov 24 16:05:51.554560 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:51.582099 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-b4bc974d-3a38-458c-b24b-ce557e01536a service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2898583 Nov 24 16:05:51.614608 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-980c526a-cac1-4f01-aed0-21e100aa4a6b req-6dab4841-da58-4f0e-8d07-8dc5da2425d1 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4598291 Nov 24 16:05:51.616493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:51.672262 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 req-335cd4ca-cb46-4191-9f6b-d12225744594 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1190097 Nov 24 16:05:51.715827 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:51.723547 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:51.725590 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b877f036-0e42-4437-8aa5-f61bf71658d4 HTTP/1.1" status: 204 len: 168 time: 0.5090787 Nov 24 16:05:51.726803 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 req-081dca0b-96da-4d33-9964-5c8da4082ba6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1704869 Nov 24 16:05:51.757656 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-f1fbe7bd-8030-4707-8696-0829c5582f09 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2107894 Nov 24 16:05:51.785182 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 req-d9e124e9-4909-425e-9b90-21321a453539 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1911995 Nov 24 16:05:51.806328 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 x-openstack-request-id: req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:51.807563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:51.808141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:51.808712 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5', 'status': 'completed', 'code': 200} Nov 24 16:05:51.809607 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6407d5ba-04fc-42c2-9dbc-eea66e69bc78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b877f036-0e42-4437-8aa5-f61bf71658d4,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:51.957631 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-1a749c03-7ade-4aa5-8768-14651bbc6420 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.959539 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-1a749c03-7ade-4aa5-8768-14651bbc6420 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1096 time: 0.1839364 Nov 24 16:05:51.971296 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3271fd49-c7e6-454c-8af3-d52a160d5123 req-4d2e70f2-3180-4ecb-b188-619f525b1e68 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:51.975882 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3271fd49-c7e6-454c-8af3-d52a160d5123 req-4d2e70f2-3180-4ecb-b188-619f525b1e68 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.1517174 Nov 24 16:05:52.106421 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3271fd49-c7e6-454c-8af3-d52a160d5123 req-2a51f8cd-82db-4a44-92ca-f1f349aa8bdd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185627 Nov 24 16:05:52.115821 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e1338c-f9ca-4638-b750-f9e78224b585 req-892ebd21-16d3-4f32-bc2f-6998b053e0b5 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3294003 Nov 24 16:05:52.128479 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-2f4d7d00-485d-4843-98bc-8a644dbdc771 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.130246 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-2f4d7d00-485d-4843-98bc-8a644dbdc771 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1096 time: 0.2199495 Nov 24 16:05:52.136314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-a5032a5b-6f2f-478f-b67f-0cb36b733aed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.138255 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-a5032a5b-6f2f-478f-b67f-0cb36b733aed service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.1641958 Nov 24 16:05:52.139914 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b97226-f39f-4791-9980-6e21eed4645c req-bde9a489-25f5-439d-92a4-29ff2076a34d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.141701 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5b97226-f39f-4791-9980-6e21eed4645c req-bde9a489-25f5-439d-92a4-29ff2076a34d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.1217127 Nov 24 16:05:52.236152 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-60fc1a46-cb26-407f-ab9f-23e1d6b7e55c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.0838892 Nov 24 16:05:52.327473 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5b97226-f39f-4791-9980-6e21eed4645c req-129e6b44-052e-4533-9f79-4f9205eeeaf3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1616049 Nov 24 16:05:52.378411 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-6004bd00-eca0-472e-b493-eff703d598e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.380248 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-6004bd00-eca0-472e-b493-eff703d598e6 service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.2374449 Nov 24 16:05:52.419451 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-d3acfe7c-f4f5-4ee5-8aa6-cd1acab7744d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.421506 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-d3acfe7c-f4f5-4ee5-8aa6-cd1acab7744d service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.1743827 Nov 24 16:05:52.470557 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-522ea501-ca4c-40a7-8552-c518babbf552 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0402951 Nov 24 16:05:52.484740 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e req-f50f89ac-c537-4c7e-b53c-90d74033d4e2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.486732 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e req-f50f89ac-c537-4c7e-b53c-90d74033d4e2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 944 time: 0.1225448 Nov 24 16:05:52.622750 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:52.625774 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e req-264b238f-570f-4251-8aee-993d8108654d tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1284359 Nov 24 16:05:52.656910 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-b5a1142d-aa93-4151-a58b-b2e354a154ae service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 217 time: 0.2688377 Nov 24 16:05:52.666364 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-7a47867f-2e81-4e76-89fb-327bc8ec9bfe service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1784122 Nov 24 16:05:52.715406 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-d1968f76-f675-4051-a4d3-0a702dcdde14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.719143 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-d1968f76-f675-4051-a4d3-0a702dcdde14 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0542183 Nov 24 16:05:52.840458 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-ccee7c34-ab83-44cf-8e8f-610c3282cac4 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1662536 Nov 24 16:05:52.855892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:52.869152 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-14883523-2968-41b6-8bc1-fa3acd34cf55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.870431 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-14883523-2968-41b6-8bc1-fa3acd34cf55 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1440582 Nov 24 16:05:52.931610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19319a3c-742d-471d-9645-07dbc4db61f5 req-3a11aca2-1426-400c-ab9c-a057d1002d09 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.940182 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-19319a3c-742d-471d-9645-07dbc4db61f5 req-3a11aca2-1426-400c-ab9c-a057d1002d09 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.1537585 Nov 24 16:05:52.976204 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa req-6e5f5bcd-08c9-498f-ad75-1b09ce3488e7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:52.977983 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa req-6e5f5bcd-08c9-498f-ad75-1b09ce3488e7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0765746 Nov 24 16:05:52.992795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:52.995787 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-806565ad-a361-4e5f-86e2-38da762062c5" -d '{"events": [{"name": "network-changed", "server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:53.041194 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa req-deb4688d-070a-4b22-81ab-1432009116cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546579 Nov 24 16:05:53.081194 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:53.095953 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:53.110630 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-19319a3c-742d-471d-9645-07dbc4db61f5 req-1d2036a5-2ca6-4059-92d6-66e73b827b74 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1694243 Nov 24 16:05:53.135443 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 x-openstack-request-id: req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:53.136767 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:53.139082 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:53.139600 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d', 'status': 'completed', 'code': 200} Nov 24 16:05:53.162440 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:53.162595 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-b5328eb1-8225-474c-9e31-c8e5381297c3 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2790051 Nov 24 16:05:53.193548 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:53.237522 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:53.243119 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:53.244323 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 691eb29c-951c-4f72-b283-76d5f14e961e details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:53.305861 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806565ad-a361-4e5f-86e2-38da762062c5 req-e873f004-4f6a-4a6e-89ff-a68813507ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.316115 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-e873f004-4f6a-4a6e-89ff-a68813507ecb service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 1096 time: 0.1367974 Nov 24 16:05:53.356207 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:53.416459 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-4328307d-8258-4785-b197-654a9ed8e4c1 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2492638 Nov 24 16:05:53.484366 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e req-6ec02576-7881-4f82-97bf-8b729bb67e57 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.486367 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e req-6ec02576-7881-4f82-97bf-8b729bb67e57 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 943 time: 0.2059348 Nov 24 16:05:53.487979 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=691eb29c-951c-4f72-b283-76d5f14e961e,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:53.523228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '691eb29c-951c-4f72-b283-76d5f14e961e', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'port_id': '691eb29c-951c-4f72-b283-76d5f14e961e', 'mac_address': 'fa:16:3e:b2:5f:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3e375f9-d96e-4117-a4ce-55baac3893ba', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:53.580607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 req-36de44a7-aa26-4fb9-b7a1-4987361967d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.580888 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 req-36de44a7-aa26-4fb9-b7a1-4987361967d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.1014485 Nov 24 16:05:53.594912 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806565ad-a361-4e5f-86e2-38da762062c5 req-795e7557-aa50-4ab6-a84d-48190d61b532 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.599214 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-795e7557-aa50-4ab6-a84d-48190d61b532 service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.2502973 Nov 24 16:05:53.603860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:53.627333 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 691eb29c-951c-4f72-b283-76d5f14e961e {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:53.629548 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e req-1b129aaa-0655-4a5c-949f-0d5bdc1e4157 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276436 Nov 24 16:05:53.678973 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=691eb29c-951c-4f72-b283-76d5f14e961e,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:53.680920 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-ac68758b-cbe5-48b1-8f99-a291a0c99a31 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=a424f220-1812-4f50-ab01-68a1923ec96d HTTP/1.1" status: 200 len: 217 time: 0.0741870 Nov 24 16:05:53.684555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:53.689679 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device af829109-ec6d-4b1f-b501-099d680019fe details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:53.696005 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 req-020638ad-1c71-4ddb-a114-291ce6d71035 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048038 Nov 24 16:05:53.782589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806565ad-a361-4e5f-86e2-38da762062c5 req-a991cb07-de98-4c52-a0e5-1111183edeb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.784424 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-a991cb07-de98-4c52-a0e5-1111183edeb2 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.0965350 Nov 24 16:05:53.847329 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-f1738864-2911-4ef5-939b-5271c954edf6 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0513985 Nov 24 16:05:53.883485 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:53.914675 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3023778a-36b2-4756-bf6c-10b943260a27 req-fd53d35b-6784-490a-9a76-c91aa8b5f016 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:53.916318 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3023778a-36b2-4756-bf6c-10b943260a27 req-fd53d35b-6784-490a-9a76-c91aa8b5f016 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 944 time: 0.1309772 Nov 24 16:05:53.948711 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=af829109-ec6d-4b1f-b501-099d680019fe,segment=NetworkSegment(cfd8620d-0436-44f1-9416-05a3b74c08b2),segment_id=cfd8620d-0436-44f1-9416-05a3b74c08b2)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:53.971668 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'af829109-ec6d-4b1f-b501-099d680019fe', 'network_id': '3a3f8b84-e6ed-4689-a795-ab7b4d769ab7', 'port_id': 'af829109-ec6d-4b1f-b501-099d680019fe', 'mac_address': 'fa:16:3e:66:42:1e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1036, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73ce2b53-9439-498a-9f86-2224119f5b5b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:54.016451 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.031011 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af829109-ec6d-4b1f-b501-099d680019fe {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:54.041289 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3023778a-36b2-4756-bf6c-10b943260a27 req-15efbf12-cf3c-4f50-9f8c-528fafef4a50 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1068943 Nov 24 16:05:54.045639 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-dd0e75b5-be60-43af-a91d-66512e9e5138 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1900439 Nov 24 16:05:54.057181 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=af829109-ec6d-4b1f-b501-099d680019fe,segment=NetworkSegment(cfd8620d-0436-44f1-9416-05a3b74c08b2),segment_id=cfd8620d-0436-44f1-9416-05a3b74c08b2)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:54.065713 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.117876 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:54.155642 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-51cc7f83-845f-4a24-89a2-db85f2d46403 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1015692 Nov 24 16:05:54.195566 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2418f89-c494-4677-9f21-4d39b1a1cda6 req-48f5bc19-128d-480f-95ba-435f8707ef17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:54.197274 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c2418f89-c494-4677-9f21-4d39b1a1cda6 req-48f5bc19-128d-480f-95ba-435f8707ef17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0567009 Nov 24 16:05:54.261800 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c2418f89-c494-4677-9f21-4d39b1a1cda6 req-af9a6455-e4fa-4838-afec-2eb5af093e73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580552 Nov 24 16:05:54.301377 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.321192 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3834391-875d-425d-b852-7b55bd518491 req-2d96b5bd-4ba8-4a00-aa2a-787e8b5da70f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:54.322763 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d3834391-875d-425d-b852-7b55bd518491 req-2d96b5bd-4ba8-4a00-aa2a-787e8b5da70f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.0686839 Nov 24 16:05:54.383581 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d3834391-875d-425d-b852-7b55bd518491 req-b91d0d7b-d45f-43fd-8ddc-d373105eed65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541921 Nov 24 16:05:54.429818 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.635180 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59632) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:54.672335 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0cc6f513-6305-463b-bb1d-17ec8928f67c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:05:54.737347 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:05:54.784112 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-846c8b4e-2e3f-43d1-98c9-d0b4c385af21 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.802837 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['af829109-ec6d-4b1f-b501-099d680019fe'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:05:54.814970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69317f6d-0152-494e-a03a-d8780ce9ef04 req-c663ce0c-5b6b-4357-b6ee-5eedcd46d615 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:54.817761 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69317f6d-0152-494e-a03a-d8780ce9ef04 req-c663ce0c-5b6b-4357-b6ee-5eedcd46d615 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 944 time: 0.0722826 Nov 24 16:05:54.871741 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cd058d-15ca-4343-9a88-44029e224965 req-968353d8-5660-476e-96f6-cac4902b2f47 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:54.874165 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a1cd058d-15ca-4343-9a88-44029e224965 req-968353d8-5660-476e-96f6-cac4902b2f47 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.0851119 Nov 24 16:05:54.923249 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69317f6d-0152-494e-a03a-d8780ce9ef04 req-f293b27a-9749-4835-b1a3-bca0720b1cb2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913112 Nov 24 16:05:54.975841 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-846c8b4e-2e3f-43d1-98c9-d0b4c385af21 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:54.980807 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-846c8b4e-2e3f-43d1-98c9-d0b4c385af21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.008301 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:05:55.020250 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a1cd058d-15ca-4343-9a88-44029e224965 req-f7893e4b-bdc2-4fd1-a7b7-7ef87fbe243a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206570 Nov 24 16:05:55.045918 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846c8b4e-2e3f-43d1-98c9-d0b4c385af21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b376caff-9aed-41d8-9904-0b84cd78a0be,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:55.051045 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-846c8b4e-2e3f-43d1-98c9-d0b4c385af21 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=ea6ad993dc1448fd9e65bd47233da829&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4145706 Nov 24 16:05:55.054140 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59644) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:55.183765 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.236955 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.237192 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 req-80af03cf-626c-493a-b3d8-2aebb0ba744c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:55.254530 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 req-80af03cf-626c-493a-b3d8-2aebb0ba744c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 945 time: 0.1179903 Nov 24 16:05:55.315764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.321725 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.323990 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b376caff-9aed-41d8-9904-0b84cd78a0be HTTP/1.1" status: 204 len: 168 time: 0.2681270 Nov 24 16:05:55.348915 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75e278d-70ad-4b8d-967e-6d93d1abe862 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b376caff-9aed-41d8-9904-0b84cd78a0be,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:55.374212 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 req-a4950b27-bd37-4ef2-88ca-bd6d729f5134 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183965 Nov 24 16:05:55.430445 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb6d30-bd9d-45b5-815c-c02972466cf4 req-1e6ef99a-3d96-4ccf-82c3-6291eaf0b8a7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:55.432007 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fffb6d30-bd9d-45b5-815c-c02972466cf4 req-1e6ef99a-3d96-4ccf-82c3-6291eaf0b8a7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0596831 Nov 24 16:05:55.491117 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fffb6d30-bd9d-45b5-815c-c02972466cf4 req-dd0b3105-8c67-452c-9f4f-9b8483b3c69d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515709 Nov 24 16:05:55.538807 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcce511a-4335-4665-b34f-e5651861666b req-786b7906-61e5-41dc-96ba-6103ec0cfde5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:55.540344 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dcce511a-4335-4665-b34f-e5651861666b req-786b7906-61e5-41dc-96ba-6103ec0cfde5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.0669158 Nov 24 16:05:55.597495 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dcce511a-4335-4665-b34f-e5651861666b req-19dea930-4aed-4463-8dd0-9152fac3a82d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475664 Nov 24 16:05:55.728299 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59670) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:55.743259 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa5ce196-4ef9-480f-b797-34c78b61f025 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.865142 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa5ce196-4ef9-480f-b797-34c78b61f025 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.870817 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa5ce196-4ef9-480f-b797-34c78b61f025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:55.918988 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-aa5ce196-4ef9-480f-b797-34c78b61f025 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=857da09700cf4666a9bfca82ff81c9a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1856661 Nov 24 16:05:55.918988 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5ce196-4ef9-480f-b797-34c78b61f025 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88e1b87a-019b-4dbc-a042-188a641e2e0d,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:55.919997 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59680) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:55.990422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:56.014263 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:56.066564 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 req-69e37c6a-be86-4278-8db1-8f4b2b5f0d07 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:56.073643 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 req-69e37c6a-be86-4278-8db1-8f4b2b5f0d07 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 944 time: 0.0672193 Nov 24 16:05:56.087403 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:56.090681 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:56.092518 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/88e1b87a-019b-4dbc-a042-188a641e2e0d HTTP/1.1" status: 204 len: 168 time: 0.1717803 Nov 24 16:05:56.112158 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ce8c24-2d93-4697-b4a4-454dca035db9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88e1b87a-019b-4dbc-a042-188a641e2e0d,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:56.158538 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 req-0dfd71fc-ab49-426f-b275-532c222b545c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838668 Nov 24 16:05:56.207134 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e85144-f21a-42e0-9c73-63ccb2c3f508 req-165d2814-4db1-49eb-a799-807e18beb16b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:56.209271 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-78e85144-f21a-42e0-9c73-63ccb2c3f508 req-165d2814-4db1-49eb-a799-807e18beb16b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.0819547 Nov 24 16:05:56.277311 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-78e85144-f21a-42e0-9c73-63ccb2c3f508 req-bf5356a6-287a-4328-a532-398b69063857 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604408 Nov 24 16:05:56.487425 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 req-e4d5a7fb-1461-4c9e-a1e2-8b1603c1298d tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:56.488966 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 req-e4d5a7fb-1461-4c9e-a1e2-8b1603c1298d tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 945 time: 0.0571942 Nov 24 16:05:56.550971 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 req-e4ae68a1-c771-42f0-8983-4e9703081b76 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555701 Nov 24 16:05:56.624951 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96394a55-59bd-4e17-adef-18e689c7331b req-3b9f72fa-514b-4fae-9498-b7e78c44ba2c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:56.627275 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96394a55-59bd-4e17-adef-18e689c7331b req-3b9f72fa-514b-4fae-9498-b7e78c44ba2c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0586147 Nov 24 16:05:56.688821 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96394a55-59bd-4e17-adef-18e689c7331b req-3b914c8f-d57f-404c-8a62-96bab59294a5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543330 Nov 24 16:05:56.737863 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b6b7c1-63bf-466e-9fe4-949db567a996 req-dcfac9c4-771e-418f-95ee-214f59e5d741 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:56.739556 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-46b6b7c1-63bf-466e-9fe4-949db567a996 req-dcfac9c4-771e-418f-95ee-214f59e5d741 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.0699050 Nov 24 16:05:56.797317 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-46b6b7c1-63bf-466e-9fe4-949db567a996 req-ca7405d3-147d-476a-8908-00a08c16c11f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0513544 Nov 24 16:05:57.332334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f198dd-194a-46da-8e6b-a6c01d31c36e req-b57b523a-60f5-4a4a-8333-57c3f4715227 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:57.334358 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8f198dd-194a-46da-8e6b-a6c01d31c36e req-b57b523a-60f5-4a4a-8333-57c3f4715227 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 944 time: 0.0795412 Nov 24 16:05:57.441448 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8f198dd-194a-46da-8e6b-a6c01d31c36e req-1c071ed9-e4a7-4866-872d-1167d53c5c16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977032 Nov 24 16:05:57.482850 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bba9562-a828-42c5-936f-5333c98c9259 req-c6ff7275-a15e-45e2-afc2-438f0e73c72b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:57.484938 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4bba9562-a828-42c5-936f-5333c98c9259 req-c6ff7275-a15e-45e2-afc2-438f0e73c72b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 943 time: 0.1115601 Nov 24 16:05:57.551642 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 533d257a-8aad-4722-8f01-84015f80cdd5 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:57.572708 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59742) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:57.586579 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4bba9562-a828-42c5-936f-5333c98c9259 req-55c95b6b-a1ec-4b97-a7c6-d7cf0f5c7902 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909469 Nov 24 16:05:57.609088 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:57.720931 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997e02e5-c353-467c-8cf2-bcaa77857d38 req-bc6d695a-ff8a-4cc0-8842-938983348532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:57.731712 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=533d257a-8aad-4722-8f01-84015f80cdd5,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:57.744119 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-997e02e5-c353-467c-8cf2-bcaa77857d38 req-bc6d695a-ff8a-4cc0-8842-938983348532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 945 time: 0.0770495 Nov 24 16:05:57.753352 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '533d257a-8aad-4722-8f01-84015f80cdd5', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'port_id': '533d257a-8aad-4722-8f01-84015f80cdd5', 'mac_address': 'fa:16:3e:ee:9c:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1035, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:57.756911 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 0cc6f513-6305-463b-bb1d-17ec8928f67c completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:05:57.761792 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 0cc6f513-6305-463b-bb1d-17ec8928f67c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:57.762162 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:57.817952 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-997e02e5-c353-467c-8cf2-bcaa77857d38 req-eef14c0f-91d5-4002-b40e-61a7666edd38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693884 Nov 24 16:05:57.837391 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d92ea4e7-f394-46c5-bcf6-c5926f1c7958 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:57.852191 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:57.892062 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 533d257a-8aad-4722-8f01-84015f80cdd5 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:57.925650 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4f92a-67f3-4b35-b205-e8efcff95d1f req-9dce204b-74b6-4870-8506-066041cd9b3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:57.927452 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-97a4f92a-67f3-4b35-b205-e8efcff95d1f req-9dce204b-74b6-4870-8506-066041cd9b3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0952880 Nov 24 16:05:57.931188 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=533d257a-8aad-4722-8f01-84015f80cdd5,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:57.963018 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:57.963700 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a424f220-1812-4f50-ab01-68a1923ec96d details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:57.992961 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-97a4f92a-67f3-4b35-b205-e8efcff95d1f req-f563e191-7b46-4755-9836-31873b1c2206 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583239 Nov 24 16:05:58.020705 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4147208-650e-4ff9-ae40-60e13a8097bc req-3096a68c-2453-484b-a448-e4991ec81716 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:58.029111 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4147208-650e-4ff9-ae40-60e13a8097bc req-3096a68c-2453-484b-a448-e4991ec81716 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 943 time: 0.0992734 Nov 24 16:05:58.050213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.050213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a424f220-1812-4f50-ab01-68a1923ec96d,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:58.057718 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d92ea4e7-f394-46c5-bcf6-c5926f1c7958 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.087798 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d92ea4e7-f394-46c5-bcf6-c5926f1c7958 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.111502 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4147208-650e-4ff9-ae40-60e13a8097bc req-371aa7c0-0846-44a4-b83b-22a87266291a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0814583 Nov 24 16:05:58.116997 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:58.121818 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:05:58.136911 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d92ea4e7-f394-46c5-bcf6-c5926f1c7958 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0d17226bb9bc4ebdb879ea263e934960&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5629067 Nov 24 16:05:58.141086 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59764) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:58.166448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92ea4e7-f394-46c5-bcf6-c5926f1c7958 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e7fb304-a482-4e20-ad8f-0d192a500886,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:58.201328 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.202339 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 691eb29c-951c-4f72-b283-76d5f14e961e up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:58.204388 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'a424f220-1812-4f50-ab01-68a1923ec96d', 'network_id': 'df42b516-6753-481b-a21c-74d7dd325e73', 'port_id': 'a424f220-1812-4f50-ab01-68a1923ec96d', 'mac_address': 'fa:16:3e:63:b8:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1035, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e60a04ed-2a73-4097-a8e3-582d7b1a8d1f', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:58.213650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.239235 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.293589 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.297273 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.298474 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/5e7fb304-a482-4e20-ad8f-0d192a500886 HTTP/1.1" status: 204 len: 168 time: 0.1564188 Nov 24 16:05:58.307852 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f41542-ca63-4dcd-88e4-57ee26554c1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e7fb304-a482-4e20-ad8f-0d192a500886,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:58.317394 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:58.369942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b536164-d89c-433d-a29f-05d5cfe82223" -d '{"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:05:58.386425 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.418740 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a424f220-1812-4f50-ab01-68a1923ec96d {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:58.435146 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:58.446434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 691eb29c-951c-4f72-b283-76d5f14e961e completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:05:58.453344 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a424f220-1812-4f50-ab01-68a1923ec96d,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:58.455372 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 691eb29c-951c-4f72-b283-76d5f14e961e triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:58.455778 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.485145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.485908 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:05:58.599239 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:58.666401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 req-96827074-4b52-4e14-ae5c-b17488701e41 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:58.680482 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 req-96827074-4b52-4e14-ae5c-b17488701e41 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 944 time: 0.1235483 Nov 24 16:05:58.701726 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.709333 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:58.735156 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'port_id': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'mac_address': 'fa:16:3e:3d:59:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1041, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:05:58.775593 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 req-fbad91de-6d84-46f6-9731-fb8bc4311d2d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934980 Nov 24 16:05:58.785693 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=691eb29c-951c-4f72-b283-76d5f14e961e,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:58.803040 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.804448 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device af829109-ec6d-4b1f-b501-099d680019fe up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:05:58.914366 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:05:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-179a8a20-d931-42fb-9311-51b69549db29 x-openstack-request-id: req-179a8a20-d931-42fb-9311-51b69549db29 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:05:58.914856 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:05:58.915279 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-179a8a20-d931-42fb-9311-51b69549db29 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:05:58.915998 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'code': 200} Nov 24 16:05:58.967651 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:58.985508 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 req-8753b71e-6220-4247-a3a4-7706c7a52092 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:58.999939 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 req-8753b71e-6220-4247-a3a4-7706c7a52092 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.1137974 Nov 24 16:05:59.018884 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:59.030013 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:05:59.057339 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 59796) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:59.062479 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port af829109-ec6d-4b1f-b501-099d680019fe completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:05:59.076314 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a91c1d22-723a-4339-9a65-25ed4133d201 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.082821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:59.084945 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port af829109-ec6d-4b1f-b501-099d680019fe triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:05:59.085665 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.092843 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.109065 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa req-25ba5dbc-7409-471a-9020-b186adf39f24 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:59.134890 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa req-25ba5dbc-7409-471a-9020-b186adf39f24 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 945 time: 0.1225708 Nov 24 16:05:59.216593 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:59.226827 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 req-b5500c9b-67e4-4e53-8637-18a04dc1d9e6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2261496 Nov 24 16:05:59.246723 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a91c1d22-723a-4339-9a65-25ed4133d201 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.253245 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a91c1d22-723a-4339-9a65-25ed4133d201 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.281547 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa req-1561b6c1-6ee1-4e64-87e6-738567788cfa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1456845 Nov 24 16:05:59.298477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.316737 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91c1d22-723a-4339-9a65-25ed4133d201 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83bbea85-2d02-4aa6-978f-199cce8f88dc,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:59.358206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 59808) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:05:59.361626 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a91c1d22-723a-4339-9a65-25ed4133d201 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=df51a42917124f4bb4ba7e1d029af3f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3031371 Nov 24 16:05:59.372019 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=af829109-ec6d-4b1f-b501-099d680019fe,segment=NetworkSegment(cfd8620d-0436-44f1-9416-05a3b74c08b2),segment_id=cfd8620d-0436-44f1-9416-05a3b74c08b2)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:05:59.383048 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.429616 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 req-49b92441-ee19-47f9-8602-2b06c7bec981 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:59.431765 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 req-49b92441-ee19-47f9-8602-2b06c7bec981 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0687199 Nov 24 16:05:59.456961 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:59.499041 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.509647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c45113-a82e-45df-9840-7f3fa8b1b14e req-f3ced0ce-237a-4ef7-a185-56c069908bb9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:59.511403 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-50c45113-a82e-45df-9840-7f3fa8b1b14e req-f3ced0ce-237a-4ef7-a185-56c069908bb9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0711937 Nov 24 16:05:59.518333 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 req-32d9bfee-b9e2-4003-8348-9e45b6d408ce tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767398 Nov 24 16:05:59.550530 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.614038 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-50c45113-a82e-45df-9840-7f3fa8b1b14e req-70f4b53d-2a4e-46fb-a606-1c91cd61d427 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0937855 Nov 24 16:05:59.641724 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.645203 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:05:59.645920 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/83bbea85-2d02-4aa6-978f-199cce8f88dc HTTP/1.1" status: 204 len: 168 time: 0.2866974 Nov 24 16:05:59.657831 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba45974-919c-4dde-aca1-c7aa9f325453 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83bbea85-2d02-4aa6-978f-199cce8f88dc,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:05:59.919652 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a32b1e-8236-4a36-80c9-d48c609d73c0 req-eaeee802-755f-4cc9-9085-3c9a0834c64f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:05:59.929082 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96a32b1e-8236-4a36-80c9-d48c609d73c0 req-eaeee802-755f-4cc9-9085-3c9a0834c64f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0781748 Nov 24 16:05:59.993602 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96a32b1e-8236-4a36-80c9-d48c609d73c0 req-9cc40d76-cdfe-4198-9d0a-eb004eabaca3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634518 Nov 24 16:06:00.066361 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-747ef21e-962e-4abb-a2a3-b139d9c96a45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:00.069051 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-747ef21e-962e-4abb-a2a3-b139d9c96a45 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1098 time: 0.1239297 Nov 24 16:06:00.141553 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-73b1833c-314c-496c-95f0-3786c1b355b1 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:00.291528 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-73b1833c-314c-496c-95f0-3786c1b355b1 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:00.297347 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-73b1833c-314c-496c-95f0-3786c1b355b1 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:00.360831 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-08720f3f-2b5d-4ce4-9fad-a16f3d9708c4 req-73b1833c-314c-496c-95f0-3786c1b355b1 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2326529 Nov 24 16:06:00.361846 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b1833c-314c-496c-95f0-3786c1b355b1 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=5ecc1ff4-1b57-475b-b455-ab983ffb5f64,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:00.438941 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d08135d-e787-4be9-b5af-899b58208616 req-6c0d2ce0-a274-4787-bf4a-aa2b205abcf0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:00.442028 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2d08135d-e787-4be9-b5af-899b58208616 req-6c0d2ce0-a274-4787-bf4a-aa2b205abcf0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0762801 Nov 24 16:06:00.493448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 req-482e0669-c18c-4134-aa8a-03f47622a6f6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:00.496219 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 req-482e0669-c18c-4134-aa8a-03f47622a6f6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0859377 Nov 24 16:06:00.545703 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2d08135d-e787-4be9-b5af-899b58208616 req-0ee5d4d0-6b88-43ff-8b11-324c99278989 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934215 Nov 24 16:06:00.621534 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 req-51bc587b-b487-45d5-8e7f-b9ff88e54f85 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1130986 Nov 24 16:06:00.744393 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88607e7a-524a-4c52-ade6-7ee77e2ff231 req-0cfe870f-9537-43f1-bc7e-b594a51b0587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:00.748150 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88607e7a-524a-4c52-ade6-7ee77e2ff231 req-0cfe870f-9537-43f1-bc7e-b594a51b0587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0760520 Nov 24 16:06:00.771815 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b26e37-7d04-4f1e-9acf-b041208d0e4e req-476b63be-5fdf-4733-ac00-00c8853fb367 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:00.773929 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-08b26e37-7d04-4f1e-9acf-b041208d0e4e req-476b63be-5fdf-4733-ac00-00c8853fb367 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0659924 Nov 24 16:06:00.819617 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88607e7a-524a-4c52-ade6-7ee77e2ff231 req-2840e1a9-74e6-4b7f-b639-f722b03d4927 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632236 Nov 24 16:06:00.844411 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-08b26e37-7d04-4f1e-9acf-b041208d0e4e req-17a569b2-4b8a-4b03-b101-f285ebbd573c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599079 Nov 24 16:06:00.917096 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e'}, {'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:00.920165 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-facc1911-4960-4ecc-b519-86478eb92a58" -d '{"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-plugged", "status": "completed", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}, {"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-plugged", "status": "completed", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:00.987158 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 x-openstack-request-id: req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:00.987735 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-plugged", "status": "completed", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e", "code": 200}, {"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-plugged", "status": "completed", "tag": "af829109-ec6d-4b1f-b501-099d680019fe", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:00.988107 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:00.988525 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e', 'code': 200} Nov 24 16:06:00.988858 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe', 'code': 200} Nov 24 16:06:01.120794 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23a2782-b31b-4c53-bb92-1bc582139827 req-fde233a9-10eb-47a1-aaa7-fbd5943543ed tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:01.123052 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c23a2782-b31b-4c53-bb92-1bc582139827 req-fde233a9-10eb-47a1-aaa7-fbd5943543ed tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0543346 Nov 24 16:06:01.191254 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c23a2782-b31b-4c53-bb92-1bc582139827 req-9f0a9f1c-0cb4-4040-928e-173b596c51e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614030 Nov 24 16:06:01.765351 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f55941f-9763-42a2-b97e-8c49ca692236 req-5510b522-d277-468d-8e83-fd15408b3284 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:01.767104 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f55941f-9763-42a2-b97e-8c49ca692236 req-5510b522-d277-468d-8e83-fd15408b3284 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0685961 Nov 24 16:06:01.779426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f2f2ab-6646-44f6-b375-c0a482e7550b req-233e2326-7c01-4c98-80b0-2847829d6cbc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:01.782343 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-44f2f2ab-6646-44f6-b375-c0a482e7550b req-233e2326-7c01-4c98-80b0-2847829d6cbc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0698049 Nov 24 16:06:01.841643 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f55941f-9763-42a2-b97e-8c49ca692236 req-bc05f047-acee-478b-a577-1b6223218222 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658076 Nov 24 16:06:01.863705 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-44f2f2ab-6646-44f6-b375-c0a482e7550b req-0e81ac0d-e03e-416f-9888-63f7ff17ad7d tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736463 Nov 24 16:06:01.987881 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c424dd26-caa3-4d16-8c92-3e18044d775b req-5eacfd65-2265-4c9d-9400-c778de7e2bc8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:01.990742 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 req-193a1825-d62d-4f55-862f-3c71bd84aaf7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:01.991496 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c424dd26-caa3-4d16-8c92-3e18044d775b req-5eacfd65-2265-4c9d-9400-c778de7e2bc8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0756931 Nov 24 16:06:01.992190 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 req-193a1825-d62d-4f55-862f-3c71bd84aaf7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0519936 Nov 24 16:06:02.056102 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 req-2d9b69b5-2101-4edd-8e96-ce3973288188 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0572076 Nov 24 16:06:02.078368 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c424dd26-caa3-4d16-8c92-3e18044d775b req-6d823b60-ae8d-417c-9a65-98eff88f59da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0748594 Nov 24 16:06:02.328008 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1edaf8d6-9518-479b-ae62-169422043c6a req-6def7b3a-238c-4f2d-9f34-387109e5eab7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:02.329717 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1edaf8d6-9518-479b-ae62-169422043c6a req-6def7b3a-238c-4f2d-9f34-387109e5eab7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0573573 Nov 24 16:06:02.382105 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1edaf8d6-9518-479b-ae62-169422043c6a req-18e2046e-807e-4242-a3b4-1c3a40cad335 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462105 Nov 24 16:06:02.990857 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 req-ba3cdc8d-e2ff-4456-a190-bb01c4a14076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:02.992464 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 req-ba3cdc8d-e2ff-4456-a190-bb01c4a14076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0512390 Nov 24 16:06:03.004305 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d74b78-a282-4b07-9dc8-968e5878cde0 req-94399c55-dd9a-441d-b642-2f3e22973177 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:03.006977 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-00d74b78-a282-4b07-9dc8-968e5878cde0 req-94399c55-dd9a-441d-b642-2f3e22973177 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0858934 Nov 24 16:06:03.053887 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 req-5268872c-c609-4272-9925-cacc57b6b69b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541329 Nov 24 16:06:03.063757 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-00d74b78-a282-4b07-9dc8-968e5878cde0 req-6e1f94e0-4bea-492a-8cf8-684278c68348 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510330 Nov 24 16:06:03.220251 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b852937-c3a8-49ec-8b1a-72550e1ad56a req-3cbd1ef7-01c8-4efc-80d7-96e3b75697fc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:03.221273 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1b852937-c3a8-49ec-8b1a-72550e1ad56a req-3cbd1ef7-01c8-4efc-80d7-96e3b75697fc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0808747 Nov 24 16:06:03.254075 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 req-fc34fa2c-6d89-4b84-b4d8-d71c412833d1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:03.255663 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 req-fc34fa2c-6d89-4b84-b4d8-d71c412833d1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0740674 Nov 24 16:06:03.284369 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1b852937-c3a8-49ec-8b1a-72550e1ad56a req-973110a8-a9e3-4142-b4fd-bb04a800dbfe tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503721 Nov 24 16:06:03.310442 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 req-2f800674-535a-42c3-837e-7c8d773f2c26 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474968 Nov 24 16:06:03.503349 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74833cd0-991a-49d6-8aff-819abd710dc0 req-26c837cf-aead-47d3-b750-9f9afb52bafb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:03.504929 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-74833cd0-991a-49d6-8aff-819abd710dc0 req-26c837cf-aead-47d3-b750-9f9afb52bafb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0505791 Nov 24 16:06:03.556136 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-74833cd0-991a-49d6-8aff-819abd710dc0 req-e965f797-0d6d-4120-affb-d403f8f161da tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437310 Nov 24 16:06:04.179845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e12ccd-bffd-4773-a6f3-d42b986327a8 req-5560753b-8313-4792-89bb-ccc0bd309b03 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:04.182982 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-44e12ccd-bffd-4773-a6f3-d42b986327a8 req-5560753b-8313-4792-89bb-ccc0bd309b03 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0551088 Nov 24 16:06:04.201610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47bd6993-0273-43ac-86cd-678522f785d2 req-a1a581fb-1243-48b2-bfde-9e6b436c8579 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:04.203814 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-47bd6993-0273-43ac-86cd-678522f785d2 req-a1a581fb-1243-48b2-bfde-9e6b436c8579 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0575902 Nov 24 16:06:04.244978 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-44e12ccd-bffd-4773-a6f3-d42b986327a8 req-3145def3-a5f4-4e29-b933-ffdbdb9b3662 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508134 Nov 24 16:06:04.271851 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-47bd6993-0273-43ac-86cd-678522f785d2 req-90c2918e-22b9-4e93-b029-0d4c4e0fb730 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587149 Nov 24 16:06:04.427642 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f req-a0ef7c14-ccb8-4863-83af-91df6a090872 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:04.429199 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f req-a0ef7c14-ccb8-4863-83af-91df6a090872 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0576873 Nov 24 16:06:04.483798 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f req-fea941c7-8c02-41ed-8501-b2ea6006226b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470040 Nov 24 16:06:04.488421 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc req-715c0416-2448-4a4d-b41f-81f6756a4d3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:04.491240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc req-715c0416-2448-4a4d-b41f-81f6756a4d3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0782065 Nov 24 16:06:04.573115 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc req-b3702778-de43-4ba7-9949-b5cee8bb237f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741925 Nov 24 16:06:04.695907 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a066066f-7452-461f-a33d-b08251b4f576 req-41f96d38-1ca6-4a12-8766-3eeae7d94bd6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:04.697666 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a066066f-7452-461f-a33d-b08251b4f576 req-41f96d38-1ca6-4a12-8766-3eeae7d94bd6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0527427 Nov 24 16:06:04.697836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['1c836e44-a6b1-400d-a64b-3d1e5a65fd29'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:04.759390 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a066066f-7452-461f-a33d-b08251b4f576 req-9a5efe9f-01e2-4291-8a01-895570d1edb7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527794 Nov 24 16:06:04.861510 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['533d257a-8aad-4722-8f01-84015f80cdd5'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:04.911668 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['a424f220-1812-4f50-ab01-68a1923ec96d'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:05.306833 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7bdba4f-5459-470c-aa1f-7d13b8f6da10 req-7e2fbe67-4945-4ef0-b175-19fca3b4c200 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.308934 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c7bdba4f-5459-470c-aa1f-7d13b8f6da10 req-7e2fbe67-4945-4ef0-b175-19fca3b4c200 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 1098 time: 0.0663190 Nov 24 16:06:05.340423 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4049971e-b4a6-4323-ad5c-cb602095cc94 req-f1cd415b-1fdf-4672-86d8-d25836f14cc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.342597 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4049971e-b4a6-4323-ad5c-cb602095cc94 req-f1cd415b-1fdf-4672-86d8-d25836f14cc9 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 1099 time: 0.0991731 Nov 24 16:06:05.423050 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c7bdba4f-5459-470c-aa1f-7d13b8f6da10 req-be7fd9f2-c00e-4852-97fa-c364cc4306ab service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006606 Nov 24 16:06:05.439379 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4049971e-b4a6-4323-ad5c-cb602095cc94 req-7396f7be-79d0-458c-a48d-b81ffaa5ed19 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893922 Nov 24 16:06:05.440567 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb req-5aa14c2e-d53b-44e5-9ea2-ccb6c2409de6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.442137 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb req-5aa14c2e-d53b-44e5-9ea2-ccb6c2409de6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0721302 Nov 24 16:06:05.453279 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f751331-41ba-4316-b4f3-51760c96489a req-1b618349-0a07-4e66-bb35-cd8e0c840e5c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.454811 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0f751331-41ba-4316-b4f3-51760c96489a req-1b618349-0a07-4e66-bb35-cd8e0c840e5c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0955207 Nov 24 16:06:05.500086 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb req-2545265b-58e4-4b9d-9836-f8502b840d9e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464692 Nov 24 16:06:05.507983 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0f751331-41ba-4316-b4f3-51760c96489a req-e975cb16-450c-4ef0-97a6-4d5e54e665b3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462506 Nov 24 16:06:05.645559 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 req-8f8674cd-3951-46f7-b35b-ae4c905a1640 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.647181 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 req-8f8674cd-3951-46f7-b35b-ae4c905a1640 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0699332 Nov 24 16:06:05.721467 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 req-b1459bef-bc14-4fd5-8a11-11783e7f8aed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.723119 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 req-b1459bef-bc14-4fd5-8a11-11783e7f8aed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0506041 Nov 24 16:06:05.726354 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 req-2c826238-1eeb-434f-80fc-f326161dc0ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0710874 Nov 24 16:06:05.794775 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 req-eb9146c3-c06a-4a4a-97de-c10b26dd9dc8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0634780 Nov 24 16:06:05.888752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 req-075f99a7-32d7-40fe-99b4-a504c128a16d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:05.890361 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 req-075f99a7-32d7-40fe-99b4-a504c128a16d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0499561 Nov 24 16:06:05.941393 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 req-2b3791fc-1280-49fa-a1a3-ff0eb3702b23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447612 Nov 24 16:06:06.650247 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e504443-ce31-4b1c-a713-bbd9e050ee55 req-372c9d18-3aa2-4b48-ab72-20f3eb968b72 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:06.652111 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0e504443-ce31-4b1c-a713-bbd9e050ee55 req-372c9d18-3aa2-4b48-ab72-20f3eb968b72 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0689220 Nov 24 16:06:06.663107 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8312d10a-dd11-456e-93b0-40a704594018 req-28f3e426-14ba-4ba7-9048-f8fc74306d22 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:06.664690 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8312d10a-dd11-456e-93b0-40a704594018 req-28f3e426-14ba-4ba7-9048-f8fc74306d22 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.0711455 Nov 24 16:06:06.718436 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0e504443-ce31-4b1c-a713-bbd9e050ee55 req-e7d79521-c3a8-4140-a552-10658d5cb9f4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524039 Nov 24 16:06:06.722896 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8312d10a-dd11-456e-93b0-40a704594018 req-a9c8d41c-8e42-404d-8f16-4567140edf6d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513675 Nov 24 16:06:06.875300 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9632c541-c197-428e-80ae-d18267a93f53 req-ba1b5bd1-b9a3-417a-a5f3-00f5b4327cbc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:06.877275 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9632c541-c197-428e-80ae-d18267a93f53 req-ba1b5bd1-b9a3-417a-a5f3-00f5b4327cbc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0589945 Nov 24 16:06:06.927240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9632c541-c197-428e-80ae-d18267a93f53 req-93e095fa-5ef4-40dd-9a92-64e8a3565c36 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441093 Nov 24 16:06:06.935149 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8916fa3-ac63-41de-9e00-92f439a66b5e req-d50f92e6-2726-4f16-9d71-beade90fada2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:06.938265 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d8916fa3-ac63-41de-9e00-92f439a66b5e req-d50f92e6-2726-4f16-9d71-beade90fada2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0626500 Nov 24 16:06:07.027402 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d8916fa3-ac63-41de-9e00-92f439a66b5e req-2074cba6-9f34-44fc-8a62-76b74c385c7b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0823841 Nov 24 16:06:07.087970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5653a7ff-c2b2-425b-b667-7a228b369dcd req-b925feaa-916a-4503-8397-fb837652a4aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:07.089489 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5653a7ff-c2b2-425b-b667-7a228b369dcd req-b925feaa-916a-4503-8397-fb837652a4aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0508192 Nov 24 16:06:07.141740 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5653a7ff-c2b2-425b-b667-7a228b369dcd req-f13bf990-bb05-4568-9d57-466554c930f5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450935 Nov 24 16:06:07.901202 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 req-37cd24dc-72d1-485f-9336-3459a8444881 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:07.905411 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 req-37cd24dc-72d1-485f-9336-3459a8444881 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0846174 Nov 24 16:06:07.918089 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485b76e9-7efa-4c72-ac00-a0e590d8d1da req-f00a19ba-733b-4f33-8f1d-d7e1b9ca0b66 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:07.918670 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-485b76e9-7efa-4c72-ac00-a0e590d8d1da req-f00a19ba-733b-4f33-8f1d-d7e1b9ca0b66 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.1146958 Nov 24 16:06:07.989278 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 req-f635f00c-bc04-4a83-9345-aa06b79817ef tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762527 Nov 24 16:06:08.022561 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-485b76e9-7efa-4c72-ac00-a0e590d8d1da req-6b03c579-d6a1-43e2-a399-461a53a60be7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884128 Nov 24 16:06:08.184117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10d3dd2-502a-4146-a642-336a91eda516 req-9324b5e1-eadb-421b-b1a8-85b2f9b640bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:08.197804 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e10d3dd2-502a-4146-a642-336a91eda516 req-9324b5e1-eadb-421b-b1a8-85b2f9b640bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.0913002 Nov 24 16:06:08.240713 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86afff0b-4357-4cd7-859f-5c33ae945fa1 req-fed45f35-538a-4001-85b4-17f099f9f27a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:08.243503 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-86afff0b-4357-4cd7-859f-5c33ae945fa1 req-fed45f35-538a-4001-85b4-17f099f9f27a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0969212 Nov 24 16:06:08.322167 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e10d3dd2-502a-4146-a642-336a91eda516 req-5c322963-3e01-4bc5-93d0-0279715f5b37 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1210952 Nov 24 16:06:08.392613 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-86afff0b-4357-4cd7-859f-5c33ae945fa1 req-ad8ca088-37b5-4392-8066-97c7c6567d29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1364763 Nov 24 16:06:08.564170 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86290b0-69e3-44c4-b992-77b15955a3f1 req-bc3519f9-a4ca-442c-a556-dafd70c6db55 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:08.565978 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c86290b0-69e3-44c4-b992-77b15955a3f1 req-bc3519f9-a4ca-442c-a556-dafd70c6db55 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.1007504 Nov 24 16:06:08.652332 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c86290b0-69e3-44c4-b992-77b15955a3f1 req-8695a8c3-9fc5-4d5e-8142-fcc2eed0fe18 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746410 Nov 24 16:06:08.705263 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 533d257a-8aad-4722-8f01-84015f80cdd5 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:06:08.816152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 533d257a-8aad-4722-8f01-84015f80cdd5 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:06:08.827479 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 533d257a-8aad-4722-8f01-84015f80cdd5 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:06:08.828644 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:08.961844 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:08.989748 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:08.992067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68e6414d-00b5-4cb0-b98f-1955a4befb3d" -d '{"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-plugged", "status": "completed", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:09.009357 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=533d257a-8aad-4722-8f01-84015f80cdd5,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:09.015125 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:09.016024 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a424f220-1812-4f50-ab01-68a1923ec96d up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:06:09.135143 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb19e547-7323-424b-8ab0-fbb80901506e x-openstack-request-id: req-bb19e547-7323-424b-8ab0-fbb80901506e {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:09.135656 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-plugged", "status": "completed", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:09.136210 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-bb19e547-7323-424b-8ab0-fbb80901506e {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:09.136943 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5', 'code': 200} Nov 24 16:06:09.192036 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9c6db3-4318-4433-b953-d5b7e941b681 req-29e7cc95-3a80-4a4b-af8a-014a5aa3e99e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:09.200863 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ff9c6db3-4318-4433-b953-d5b7e941b681 req-29e7cc95-3a80-4a4b-af8a-014a5aa3e99e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0937910 Nov 24 16:06:09.260933 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60062) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:09.273117 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:09.282148 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ff9c6db3-4318-4433-b953-d5b7e941b681 req-4b179aba-d048-49b5-ae15-00125ba52789 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798635 Nov 24 16:06:09.296949 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.298185 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b req-bf56a711-2be2-4e79-9a9a-a93e7ac3504a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:09.301481 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b req-bf56a711-2be2-4e79-9a9a-a93e7ac3504a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 944 time: 0.1680367 Nov 24 16:06:09.311737 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.312102 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.312486 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.312770 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.313128 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.313466 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.313802 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.314156 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.314486 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.314815 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.315136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:09.343372 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port a424f220-1812-4f50-ab01-68a1923ec96d completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:06:09.351028 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port a424f220-1812-4f50-ab01-68a1923ec96d triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:06:09.351824 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:09.381061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677b7634-cd7b-434d-b6c2-6e3dfbdeaa42 req-fcbbb5e7-a943-46d9-acaf-350435249aa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:09.388678 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-677b7634-cd7b-434d-b6c2-6e3dfbdeaa42 req-fcbbb5e7-a943-46d9-acaf-350435249aa3 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.1010866 Nov 24 16:06:09.441607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:09.540438 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-677b7634-cd7b-434d-b6c2-6e3dfbdeaa42 req-6968e163-c52a-4fd2-bf57-ed30a02636a4 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1446927 Nov 24 16:06:09.755996 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b req-855e0e71-d8c3-4a59-9838-3bfedf61246b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4442918 Nov 24 16:06:09.797343 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:09.837066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37338b7d-7987-4ef0-853b-2cbae1076c3b req-18a1696a-9b09-4d45-8c6f-39bf46ff7e29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:09.852016 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-37338b7d-7987-4ef0-853b-2cbae1076c3b req-18a1696a-9b09-4d45-8c6f-39bf46ff7e29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 944 time: 0.3265748 Nov 24 16:06:09.870072 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:09.908338 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.028948 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=bc38ed676fc94348a2329fb2684c63fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7660739 Nov 24 16:06:10.037372 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a424f220-1812-4f50-ab01-68a1923ec96d,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:10.047900 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.048243 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60092) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:10.048750 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:06:10.142454 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a22ca9ee-27bd-4d4c-a0cf-df464942e9b3,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:10.176893 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:10.201781 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968df880-fb7a-46da-b20b-319e4b52a299 req-75335927-70e3-4367-a61b-3d14dffb74e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:10.202638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.204179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.205219 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.206027 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.206791 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.207809 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.208592 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.209392 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.210220 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.210982 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.211747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.212483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a2fb49b-1f50-4bf5-8e3a-5da183424a9a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:10.216758 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-968df880-fb7a-46da-b20b-319e4b52a299 req-75335927-70e3-4367-a61b-3d14dffb74e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.2239268 Nov 24 16:06:10.254903 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-37338b7d-7987-4ef0-853b-2cbae1076c3b req-1cc11961-6b97-4718-9cef-71d8724cc665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3682806 Nov 24 16:06:10.280579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.351894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.400913 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-968df880-fb7a-46da-b20b-319e4b52a299 req-2943b628-3726-466a-8fda-92e5b0dfb337 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1821616 Nov 24 16:06:10.406836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:06:10.424599 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:06:10.425167 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.631375 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.636062 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.636722 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.642057 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a22ca9ee-27bd-4d4c-a0cf-df464942e9b3 HTTP/1.1" status: 204 len: 168 time: 0.5859001 Nov 24 16:06:10.654330 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 req-ce35f845-ba68-4454-8799-99aa88338c95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:10.657986 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 req-ce35f845-ba68-4454-8799-99aa88338c95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.1425240 Nov 24 16:06:10.675533 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c492b9-9b4a-4a35-ad3e-b43e9de1528d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a22ca9ee-27bd-4d4c-a0cf-df464942e9b3,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:10.746253 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:10.751220 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d req-bffe8164-d2d9-4b9d-a442-7beecaf67584 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:10.754912 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:10.768752 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d req-bffe8164-d2d9-4b9d-a442-7beecaf67584 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1359093 Nov 24 16:06:10.776467 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60112) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:10.787592 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'floatingip': {'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:06:10.796331 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 req-b339ea74-31f8-43f5-a545-367ff1d790af tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1330261 Nov 24 16:06:10.864749 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:11.024522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:11.138874 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d'}, {'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:11.144533 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9" -d '{"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-plugged", "status": "completed", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}, {"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-plugged", "status": "completed", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:11.221062 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60124) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:11.248449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17b7ec0c-7268-4e65-a477-e339f361cb8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:11.309944 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 req-8b2395e4-8530-4311-a8b6-7ae880c1dd54 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:11.312052 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 req-8b2395e4-8530-4311-a8b6-7ae880c1dd54 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.3099294 Nov 24 16:06:11.442541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25d8186d-7dc0-4421-ac8b-6e702875115d x-openstack-request-id: req-25d8186d-7dc0-4421-ac8b-6e702875115d {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:11.443066 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-plugged", "status": "completed", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d", "code": 200}, {"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-plugged", "status": "completed", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:11.443494 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-25d8186d-7dc0-4421-ac8b-6e702875115d {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:11.444175 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d', 'code': 200} Nov 24 16:06:11.444615 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'code': 200} Nov 24 16:06:11.556323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17b7ec0c-7268-4e65-a477-e339f361cb8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:11.601810 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 req-1581301c-6f6a-44fd-93b6-8379a4d9d8ac tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2284524 Nov 24 16:06:11.620017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17b7ec0c-7268-4e65-a477-e339f361cb8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:11.843973 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b7ec0c-7268-4e65-a477-e339f361cb8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=039d4f78-9ace-4f26-98d9-c47610c40067,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:12.003184 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-17b7ec0c-7268-4e65-a477-e339f361cb8f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=fb2177356b6e48ddac830295a4d1ba31&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7804475 Nov 24 16:06:12.007903 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60144) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:12.167885 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 req-34ad1edf-19ab-4c22-a8b1-23f0fcaf1b06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:12.182557 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 req-34ad1edf-19ab-4c22-a8b1-23f0fcaf1b06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.6158061 Nov 24 16:06:12.189634 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79695657-2d62-426d-93c1-743da8b36142 req-39e7ade4-032f-4507-a740-93b2efc865fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:12.191177 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79695657-2d62-426d-93c1-743da8b36142 req-39e7ade4-032f-4507-a740-93b2efc865fd service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1098 time: 0.3042853 Nov 24 16:06:12.255139 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba004e44-4142-4d2c-baf8-19eb34fe6ace req-08ef6073-15fe-4414-916f-23be7b20c3fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:12.256840 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ba004e44-4142-4d2c-baf8-19eb34fe6ace req-08ef6073-15fe-4414-916f-23be7b20c3fa service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 1098 time: 0.3332291 Nov 24 16:06:12.322160 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-4f495c53-cf57-4143-8210-05b027d6f524 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2494674 Nov 24 16:06:12.368648 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.395233 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79695657-2d62-426d-93c1-743da8b36142 req-d58cee91-ee9c-4a64-a915-91b6e285260a service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1684959 Nov 24 16:06:12.423405 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 req-9d65f188-60ad-47da-bb3c-cacf1b156ff0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2399607 Nov 24 16:06:12.434246 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.508579 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ba004e44-4142-4d2c-baf8-19eb34fe6ace req-1ae02ca2-eed6-476f-b278-29ce37bcf215 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2428956 Nov 24 16:06:12.522711 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.525722 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.526930 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/039d4f78-9ace-4f26-98d9-c47610c40067 HTTP/1.1" status: 204 len: 168 time: 0.5105803 Nov 24 16:06:12.537570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16142bbf-4f70-4712-a40e-7ae882d2d56f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=039d4f78-9ace-4f26-98d9-c47610c40067,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:12.551195 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.db.resource_extend [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 16:06:12.676522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.690271 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:12.818822 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 req-1eb05ec4-0952-453b-ac44-f13ef8f540b9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:12.820414 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 req-1eb05ec4-0952-453b-ac44-f13ef8f540b9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1235523 Nov 24 16:06:12.900066 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Floating IP d3f1f528-0574-41d3-824e-682325c3b706 associated. External IP: 172.27.0.121, port: 0cc6f513-6305-463b-bb1d-17ec8928f67c. Nov 24 16:06:12.912113 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 req-12c80969-275b-4e8e-abbf-753ee187dea3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840483 Nov 24 16:06:13.117781 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-f158841d-8eb6-4eeb-b0d5-e69820cc1f58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:13.120265 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-f158841d-8eb6-4eeb-b0d5-e69820cc1f58 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=c127095ad8cc41098ef0dd79f4fcd589&device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 1099 time: 0.1497722 Nov 24 16:06:13.687527 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-e69e350f-a861-4535-84a7-833ef0ffda87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:13.689064 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-e69e350f-a861-4535-84a7-833ef0ffda87 service neutron] 10.222.0.71 "GET /v2.0/networks?id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 HTTP/1.1" status: 200 len: 913 time: 0.4930646 Nov 24 16:06:13.804267 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-819acafc-c1b1-49b3-ac2b-ce34f09b6f87 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=af829109-ec6d-4b1f-b501-099d680019fe HTTP/1.1" status: 200 len: 217 time: 0.0762563 Nov 24 16:06:13.817903 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:13.880870 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 req-ac993206-bf38-42e7-bc2a-b2890f4940e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:13.882649 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 req-ac993206-bf38-42e7-bc2a-b2890f4940e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1925807 Nov 24 16:06:14.008025 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:06:14.026588 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 req-8c262dc2-fb43-4e24-a585-5512225c6776 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1375668 Nov 24 16:06:14.042582 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-bf0f479d-0368-49f6-a275-83b2ef73092d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:14.045553 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-bf0f479d-0368-49f6-a275-83b2ef73092d service neutron] 10.222.0.71 "GET /v2.0/subnets?id=73ce2b53-9439-498a-9f86-2224119f5b5b HTTP/1.1" status: 200 len: 851 time: 0.1156332 Nov 24 16:06:14.140572 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-672c199b-ab57-44ff-a1ef-dcfa3ed17a70 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0457053 Nov 24 16:06:14.257751 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 req-a160fc6a-bd39-44e2-b233-a01db19b81af tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:14.259425 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 req-a160fc6a-bd39-44e2-b233-a01db19b81af tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1433427 Nov 24 16:06:14.326297 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:06:14.332206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:14.355064 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:06:14.374263 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 req-6b7e2679-0ea3-42bc-8a6b-f40f338cfa91 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018574 Nov 24 16:06:14.383861 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:06:14.385407 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:14.444312 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7f685561-6fbc-4f5d-87cc-92e91981d587 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "PUT /v2.0/floatingips/d3f1f528-0574-41d3-824e-682325c3b706 HTTP/1.1" status: 200 len: 991 time: 3.6653893 Nov 24 16:06:14.446091 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:14.455249 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72" -d '{"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:14.462481 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-86f8e03e-ee87-42bc-b87b-113c082ca30f service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3041956 Nov 24 16:06:14.601123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2025b08-7828-4780-8518-4c6fae9ada68 x-openstack-request-id: req-f2025b08-7828-4780-8518-4c6fae9ada68 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:14.601433 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:14.601817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-f2025b08-7828-4780-8518-4c6fae9ada68 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:14.602100 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'status': 'completed', 'code': 200} Nov 24 16:06:14.619532 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:06:14.649398 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-978a1bbb-fe35-4b98-b677-36403b04e145 req-1824a31c-5bb8-428b-91a8-d0a2e20b17da service neutron] 10.222.0.71 "GET /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1646903 Nov 24 16:06:14.730205 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-46242e94-f7c6-43ff-b365-75bd29c88cca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:14.733178 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-46242e94-f7c6-43ff-b365-75bd29c88cca service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1098 time: 0.0924578 Nov 24 16:06:15.056728 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'd3f1f528-0574-41d3-824e-682325c3b706', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.121', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:20Z', 'updated_at': '2021-11-24T16:06:12Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:15.092724 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:06:15.103764 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:06:15.104405 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:15.209422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20dc412c-791d-458f-a0e6-196a24f5d788 req-5a4ed5d2-8a1e-46ff-8589-f8c6461eb7e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:15.212428 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-20dc412c-791d-458f-a0e6-196a24f5d788 req-5a4ed5d2-8a1e-46ff-8589-f8c6461eb7e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0850964 Nov 24 16:06:15.286065 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:06:15.304850 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-20dc412c-791d-458f-a0e6-196a24f5d788 req-216e94c6-9831-4b05-9e46-025e429e2b3a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811527 Nov 24 16:06:15.582267 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b562a56d-be35-4862-b98b-217eca58222c req-9f6f81a3-78b3-4a9a-b567-5c4126a22a29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:15.584171 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b562a56d-be35-4862-b98b-217eca58222c req-9f6f81a3-78b3-4a9a-b567-5c4126a22a29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1132545 Nov 24 16:06:15.597655 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60292) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:15.602557 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'floatingip': {'port_id': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:06:15.648508 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30450ae6-7705-4514-b6f5-979f4c3758db req-c6313839-9d52-465c-8c64-3a1184848d13 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:15.654475 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:15.657280 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-30450ae6-7705-4514-b6f5-979f4c3758db req-c6313839-9d52-465c-8c64-3a1184848d13 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0980020 Nov 24 16:06:15.739728 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'd3f1f528-0574-41d3-824e-682325c3b706', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.121', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:20Z', 'updated_at': '2021-11-24T16:06:12Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:15.771118 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa25b14b-bf2f-4053-a511-342ff3b46d95 None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'd3f1f528-0574-41d3-824e-682325c3b706', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.121', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:20Z', 'updated_at': '2021-11-24T16:06:12Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:06:15.796476 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-30450ae6-7705-4514-b6f5-979f4c3758db req-ea6311eb-0a3c-4e83-9751-f1512ddfe879 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274085 Nov 24 16:06:16.214392 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78536f8-b1fd-4a41-a385-8a4797162b36 None None] New status for floating IP d3f1f528-0574-41d3-824e-682325c3b706: ACTIVE {{(pid=102789) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:06:16.315872 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 req-4367e3fc-16f1-436b-afde-563403a5b49e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:16.318411 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 req-4367e3fc-16f1-436b-afde-563403a5b49e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0887191 Nov 24 16:06:16.324111 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.331915 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.351895 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60308) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:16.416583 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 req-cde83421-5e24-4cf2-80a6-65b009ea11bc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902228 Nov 24 16:06:16.538865 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Floating IP 2f7c879e-de1b-4cc7-bfab-deb48490ee3e associated. External IP: 172.27.0.109, port: 1c836e44-a6b1-400d-a64b-3d1e5a65fd29. Nov 24 16:06:16.551292 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3bfb4b30-23a4-4e12-a3d5-82ebde4859e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.670572 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3bfb4b30-23a4-4e12-a3d5-82ebde4859e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.676422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3bfb4b30-23a4-4e12-a3d5-82ebde4859e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.754500 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-3bfb4b30-23a4-4e12-a3d5-82ebde4859e6 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a4b63c2dfc5347889205df6fc26ff0bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4005942 Nov 24 16:06:16.756394 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bfb4b30-23a4-4e12-a3d5-82ebde4859e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09d78e9a-c28b-4747-af5a-92953f011799,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:16.757699 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60314) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:16.940435 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:16.974013 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:06:16.976037 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.112610 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.115210 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.116395 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/09d78e9a-c28b-4747-af5a-92953f011799 HTTP/1.1" status: 204 len: 168 time: 0.3572268 Nov 24 16:06:17.130711 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09d78e9a-c28b-4747-af5a-92953f011799,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:17.143716 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.144067 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.144414 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.144783 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.145147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.145484 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.145814 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.146147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.146473 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.146801 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.147123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.147445 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6768ae42-4373-4773-9fab-e8aa17b2c256 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:06:17.153420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:06:17.157907 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.185384 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:06:17.204787 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-149bf848-c196-4763-af4d-bddef1d46e6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "PUT /v2.0/floatingips/2f7c879e-de1b-4cc7-bfab-deb48490ee3e HTTP/1.1" status: 200 len: 991 time: 1.6062851 Nov 24 16:06:17.205520 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:17.210588 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d763ee2f-c50e-40fe-85c5-ab5154830d4c" -d '{"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:17.210891 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:06:17.210891 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:17.410337 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:06:17.569678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60334) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:17.593242 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-655d112d-6abc-4c99-9bad-ddc2d4ca81c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.713433 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-655d112d-6abc-4c99-9bad-ddc2d4ca81c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.720695 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-655d112d-6abc-4c99-9bad-ddc2d4ca81c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.769494 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655d112d-6abc-4c99-9bad-ddc2d4ca81c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cdbe6bf-2dfb-4844-a1a9-d51e37504ab8,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:17.774544 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-655d112d-6abc-4c99-9bad-ddc2d4ca81c5 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=015691aa76364bd0b20eda190e4f4a84&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2031598 Nov 24 16:06:17.778968 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60336) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:17.851772 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '2f7c879e-de1b-4cc7-bfab-deb48490ee3e', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.109', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:3d:59:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:38Z', 'updated_at': '2021-11-24T16:06:16Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:17.858146 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.883963 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:06:17.890910 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.895926 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:06:17.896683 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:05:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:17.974459 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.977260 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:17.978719 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/5cdbe6bf-2dfb-4844-a1a9-d51e37504ab8 HTTP/1.1" status: 204 len: 168 time: 0.1987264 Nov 24 16:06:17.991170 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69e2867-1fdb-4264-be38-bd0c661b329d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cdbe6bf-2dfb-4844-a1a9-d51e37504ab8,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:18.056294 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:06:18.350082 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '2f7c879e-de1b-4cc7-bfab-deb48490ee3e', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.109', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:3d:59:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:38Z', 'updated_at': '2021-11-24T16:06:16Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:18.398837 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54c31712-57cf-4dd6-b9b8-631351a4b348 None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '2f7c879e-de1b-4cc7-bfab-deb48490ee3e', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.109', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:3d:59:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:05:38Z', 'updated_at': '2021-11-24T16:06:16Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:06:18.451328 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60348) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:18.466791 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cf9c378-a093-4910-9c12-93e177d608d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:18.561603 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cf9c378-a093-4910-9c12-93e177d608d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:18.569730 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cf9c378-a093-4910-9c12-93e177d608d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:18.620582 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e6b2eb1-3460-467a-b3e1-4e01550dc715 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:18.632806 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf9c378-a093-4910-9c12-93e177d608d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40f8edac-456f-4d64-b591-fcaed4b8322f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:18.639300 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8cf9c378-a093-4910-9c12-93e177d608d1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=35707d66c29741d0aa34b4b2077cea42&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1867986 Nov 24 16:06:18.644387 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60350) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:18.698224 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56f046da-51ad-4e9a-9139-883ccce0c519 None None] New status for floating IP 2f7c879e-de1b-4cc7-bfab-deb48490ee3e: ACTIVE {{(pid=102789) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:06:18.998801 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:19.057644 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:19.205661 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 x-openstack-request-id: req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:19.208052 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:19.208593 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:19.209314 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'status': 'completed', 'code': 200} Nov 24 16:06:19.218668 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-63c4e633-4f46-43ca-bc4d-356cc4d5a5cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.223492 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-63c4e633-4f46-43ca-bc4d-356cc4d5a5cd service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 1098 time: 0.1229763 Nov 24 16:06:19.284877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:19.289761 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:19.296825 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/40f8edac-456f-4d64-b591-fcaed4b8322f HTTP/1.1" status: 204 len: 168 time: 0.6414595 Nov 24 16:06:19.362032 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25783a4b-ac09-4b67-bfc5-7b3b7fa5d4bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40f8edac-456f-4d64-b591-fcaed4b8322f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:19.435325 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-81fd779c-a887-41f0-bda5-7fcc581a704f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.436610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-7965d990-bcd8-44bb-9530-aa6f64c1ad48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.438360 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-7965d990-bcd8-44bb-9530-aa6f64c1ad48 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.4551945 Nov 24 16:06:19.438526 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-81fd779c-a887-41f0-bda5-7fcc581a704f service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.2111480 Nov 24 16:06:19.447934 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25898f4d-fd98-4279-94af-87a7a9fd17f2 req-a798b227-c4f9-4ace-989a-7fa97bb7347f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.450107 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-25898f4d-fd98-4279-94af-87a7a9fd17f2 req-a798b227-c4f9-4ace-989a-7fa97bb7347f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1687212 Nov 24 16:06:19.452651 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-4cb46ffd-f791-4452-9018-e476d6453327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.455556 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-4cb46ffd-f791-4452-9018-e476d6453327 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1098 time: 0.1713562 Nov 24 16:06:19.540470 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-f1b037e7-97a9-4192-a632-bddab0cefaf5 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=a424f220-1812-4f50-ab01-68a1923ec96d HTTP/1.1" status: 200 len: 217 time: 0.0788257 Nov 24 16:06:19.647898 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-dff774a5-d976-4efa-9f31-d05169e91f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:19.649773 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-dff774a5-d976-4efa-9f31-d05169e91f3b service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.0907798 Nov 24 16:06:19.720222 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-581a3d92-8143-4122-bf50-21245c6427d5 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0569980 Nov 24 16:06:19.956345 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-15191eae-aabd-4fe1-b1ba-0a12334eeb6d service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2040210 Nov 24 16:06:20.007550 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-8865d332-208f-4e20-ae3a-3a638898d7e7 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 1001 time: 0.5175953 Nov 24 16:06:20.035660 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-25898f4d-fd98-4279-94af-87a7a9fd17f2 req-e0643569-094e-42e6-8770-9b7b2019c496 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5702000 Nov 24 16:06:20.183353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-9967f210-4fd8-4bcd-812e-2de1a68a18ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:20.186374 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-9967f210-4fd8-4bcd-812e-2de1a68a18ce service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.6989365 Nov 24 16:06:20.233919 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-2f7bf5e2-768a-4dfe-b6f8-93008e615a79 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2618499 Nov 24 16:06:20.309789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-8a5ed0ae-2012-4048-919d-a223444f0b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:20.312377 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-8a5ed0ae-2012-4048-919d-a223444f0b4a service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.2685063 Nov 24 16:06:20.322577 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-bd496537-45b4-432e-92f7-7e67f53fdd6d service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 1001 time: 0.1187479 Nov 24 16:06:20.459483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-1a263e8a-1333-4b49-bd86-e464aefce4ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:20.468262 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-1a263e8a-1333-4b49-bd86-e464aefce4ff service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.1319251 Nov 24 16:06:20.476793 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-85e7283d-22f6-424e-85f0-df66ecf184af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:20.478567 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-85e7283d-22f6-424e-85f0-df66ecf184af service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1417818 Nov 24 16:06:20.686743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-dacc612a-4661-45dd-a59c-4a9724337631 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:20.688138 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-dacc612a-4661-45dd-a59c-4a9724337631 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1995063 Nov 24 16:06:20.758161 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-8a753d3a-103c-43f2-a0cf-4e530a3127be service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2670591 Nov 24 16:06:20.884369 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-c603a048-8544-48da-906f-cc5275b2adce service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1776917 Nov 24 16:06:20.937873 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-e1c24712-9e97-445d-899d-25b4468db533 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509609 Nov 24 16:06:21.031529 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-4445ab7e-5bc2-47ba-891c-74b64b89517c service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273034 Nov 24 16:06:21.239754 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d77f949-f3be-4520-871e-2b4fab8bf27d req-aff0ad67-c98a-4ae3-b96f-baea6787a87d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:21.243857 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4d77f949-f3be-4520-871e-2b4fab8bf27d req-aff0ad67-c98a-4ae3-b96f-baea6787a87d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1098862 Nov 24 16:06:21.303117 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7871c4c8-f193-4f2a-9b3c-8e8eca9063bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.359741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60452) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:21.379295 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4d77f949-f3be-4520-871e-2b4fab8bf27d req-f42c415b-9b1f-47ba-ac31-3a33de8152d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1077743 Nov 24 16:06:21.523713 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4249c004-815d-49a1-9c17-915ce5aa4cd9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.652089 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4249c004-815d-49a1-9c17-915ce5aa4cd9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.657954 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4249c004-815d-49a1-9c17-915ce5aa4cd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.727949 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-4249c004-815d-49a1-9c17-915ce5aa4cd9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=984746b36ee6428e9ee4d3c298e72f11&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3667166 Nov 24 16:06:21.728830 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4249c004-815d-49a1-9c17-915ce5aa4cd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d046c706-88a6-4494-bab6-061fec3ef722,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:21.731934 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60456) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:21.817507 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.847242 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.921575 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.926037 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:21.929656 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/d046c706-88a6-4494-bab6-061fec3ef722 HTTP/1.1" status: 204 len: 168 time: 0.1940391 Nov 24 16:06:21.945652 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29941d8c-cef0-4366-b9b7-e4832b54e71b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d046c706-88a6-4494-bab6-061fec3ef722,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:22.582337 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b req-33a52527-35f8-4fa9-88aa-831a55e07f4d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:22.590729 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b req-33a52527-35f8-4fa9-88aa-831a55e07f4d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0778742 Nov 24 16:06:22.622771 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:22.666074 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b req-ba95a8ed-db66-4464-9511-837d6d5c58e3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725124 Nov 24 16:06:23.835015 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8047d50a-6031-47d9-be01-7bf2260f7b74 req-d9dffa18-425b-4055-88af-e55a54ecbf6f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:23.837385 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8047d50a-6031-47d9-be01-7bf2260f7b74 req-d9dffa18-425b-4055-88af-e55a54ecbf6f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0599334 Nov 24 16:06:23.932142 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8047d50a-6031-47d9-be01-7bf2260f7b74 req-44a4b219-a5e8-4f61-9638-04dc66361dd4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732679 Nov 24 16:06:24.016280 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60572) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:24.169529 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ea9fe29-2dae-4981-9d61-7e3b5a14b9c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.270016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ea9fe29-2dae-4981-9d61-7e3b5a14b9c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.276012 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ea9fe29-2dae-4981-9d61-7e3b5a14b9c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.302133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.325121 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea9fe29-2dae-4981-9d61-7e3b5a14b9c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ec9ff9e-9719-4ab6-8eb9-5ec60b0afe12,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:24.330977 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2ea9fe29-2dae-4981-9d61-7e3b5a14b9c7 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=bed7459f855948b1b87194b0018c657a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3133969 Nov 24 16:06:24.333556 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60586) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:24.388927 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.411908 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.438980 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.467368 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.470881 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.472293 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/2ec9ff9e-9719-4ab6-8eb9-5ec60b0afe12 HTTP/1.1" status: 204 len: 168 time: 0.1377168 Nov 24 16:06:24.495165 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9e8961-6f0d-47f5-b524-6195c0601207 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ec9ff9e-9719-4ab6-8eb9-5ec60b0afe12,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:24.856860 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60600) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:24.877245 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bc0afba4-6b0d-4ff7-8d85-89b3aa20d8d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.963731 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bc0afba4-6b0d-4ff7-8d85-89b3aa20d8d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:24.969769 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bc0afba4-6b0d-4ff7-8d85-89b3aa20d8d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:25.016043 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-bc0afba4-6b0d-4ff7-8d85-89b3aa20d8d9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=2c563bad80a54ab79af20e29dbce7334&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1580191 Nov 24 16:06:25.018380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0afba4-6b0d-4ff7-8d85-89b3aa20d8d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=996f6f33-a1b0-4a5e-8069-d7fbc7d630e6,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:25.019169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60608) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:25.073014 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8464cfc8-9972-4b96-b494-29d1d2ab5925 req-307fedc7-2c3a-4203-91da-b9c3b96ccb11 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:25.074857 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8464cfc8-9972-4b96-b494-29d1d2ab5925 req-307fedc7-2c3a-4203-91da-b9c3b96ccb11 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0523410 Nov 24 16:06:25.076279 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:25.099373 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:25.139273 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8464cfc8-9972-4b96-b494-29d1d2ab5925 req-3e89f82d-28b8-4639-9627-a83c3ee22932 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578530 Nov 24 16:06:25.178687 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:25.183789 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:25.185507 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/996f6f33-a1b0-4a5e-8069-d7fbc7d630e6 HTTP/1.1" status: 204 len: 168 time: 0.1653166 Nov 24 16:06:25.200121 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b887279a-c259-489f-bfab-421749d7097c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=996f6f33-a1b0-4a5e-8069-d7fbc7d630e6,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:26.308924 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb927bcd-dff8-488d-88d9-0bffaa02c392 req-5cb6724a-8b4d-439f-ab79-a70b4b04fb91 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:26.311325 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bb927bcd-dff8-488d-88d9-0bffaa02c392 req-5cb6724a-8b4d-439f-ab79-a70b4b04fb91 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0850983 Nov 24 16:06:26.376241 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bb927bcd-dff8-488d-88d9-0bffaa02c392 req-3f7f0899-a606-4e89-9dc8-c7cdbabacd78 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568216 Nov 24 16:06:27.517769 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 req-5dc02911-501a-4558-a08d-0f884083f0e3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:27.519442 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 req-5dc02911-501a-4558-a08d-0f884083f0e3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0548918 Nov 24 16:06:27.572908 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 req-f62d6aaf-cb6e-4c9a-bb44-c2daa8e66333 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468864 Nov 24 16:06:28.383408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60740) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:28.545905 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-0e77b510-449e-40f8-af88-8021c783762e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:28.695322 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-0e77b510-449e-40f8-af88-8021c783762e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:28.706532 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-0e77b510-449e-40f8-af88-8021c783762e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:28.764170 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9402f01b-2f74-4fa3-b593-f010a7d3a409 req-e11740c6-394b-4c25-8276-18f4297cf93a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:28.765969 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9402f01b-2f74-4fa3-b593-f010a7d3a409 req-e11740c6-394b-4c25-8276-18f4297cf93a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0777950 Nov 24 16:06:28.801617 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-0e77b510-449e-40f8-af88-8021c783762e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0df3311040244f6c84bdb9bab1906688&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4170434 Nov 24 16:06:28.805684 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60758) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:28.826737 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e77b510-449e-40f8-af88-8021c783762e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1ad62c8-42f7-4750-948f-aa3b6b94fd3f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:28.842552 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9402f01b-2f74-4fa3-b593-f010a7d3a409 req-9a6c032d-4b22-4716-9844-8d06f8793760 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661428 Nov 24 16:06:28.935619 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 req-a29e2068-f5f9-440f-a978-bd67563d1f0a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:28.937245 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 req-a29e2068-f5f9-440f-a978-bd67563d1f0a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.1156297 Nov 24 16:06:28.989407 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.031187 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 req-8669941a-d82a-48a4-b756-7355987f4494 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807524 Nov 24 16:06:29.041584 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.099777 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.105202 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.107116 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a1ad62c8-42f7-4750-948f-aa3b6b94fd3f HTTP/1.1" status: 204 len: 168 time: 0.2933602 Nov 24 16:06:29.119350 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e97ce50-10cc-4e97-8454-a590ed616e11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1ad62c8-42f7-4750-948f-aa3b6b94fd3f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:29.449939 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60774) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:29.465137 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-510dc080-2fb6-409c-b75f-ba0c3be23531 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.554678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-510dc080-2fb6-409c-b75f-ba0c3be23531 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.563529 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-510dc080-2fb6-409c-b75f-ba0c3be23531 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.606914 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-510dc080-2fb6-409c-b75f-ba0c3be23531 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=90da9cfd066640469bd24fd598252332&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1554208 Nov 24 16:06:29.607679 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510dc080-2fb6-409c-b75f-ba0c3be23531 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ae4f7f6-2355-453e-9442-1ec7c79dc230,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:29.609866 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60776) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:29.663313 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.686817 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.745632 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.749708 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:29.752812 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6ae4f7f6-2355-453e-9442-1ec7c79dc230 HTTP/1.1" status: 204 len: 168 time: 0.1415443 Nov 24 16:06:29.762139 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb7acf5-5b76-486c-827a-12ae14f55b59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ae4f7f6-2355-453e-9442-1ec7c79dc230,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:30.075876 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6277210-b5db-448a-a0c6-5a5184ed2ebe req-4cb6948b-a30d-489e-9d0a-d928fd3744db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:30.077633 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6277210-b5db-448a-a0c6-5a5184ed2ebe req-4cb6948b-a30d-489e-9d0a-d928fd3744db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0671380 Nov 24 16:06:30.160514 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6277210-b5db-448a-a0c6-5a5184ed2ebe req-7c0eaf95-6854-46dc-8dfc-78dbbaa01009 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666912 Nov 24 16:06:30.230006 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699bc666-af23-44f4-a677-b56a7288fac4 req-9cef5a41-94b6-4a21-bec8-534a997f55ca tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:30.237641 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-699bc666-af23-44f4-a677-b56a7288fac4 req-9cef5a41-94b6-4a21-bec8-534a997f55ca tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0988116 Nov 24 16:06:30.292268 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-699bc666-af23-44f4-a677-b56a7288fac4 req-d3e6b5ee-ad2a-46d4-88dd-d9893331fcf5 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520809 Nov 24 16:06:31.360596 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 req-352c674d-1431-486c-b1e1-9c58a952c249 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:31.362273 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 req-352c674d-1431-486c-b1e1-9c58a952c249 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0867305 Nov 24 16:06:31.437126 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 req-3a56391c-12fc-4373-9918-94209d6d65b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665185 Nov 24 16:06:31.465288 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da36c406-d8de-4157-b165-1cae00ec91cb req-533944b3-2a69-4b42-b219-5b459c12d135 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:31.468113 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-da36c406-d8de-4157-b165-1cae00ec91cb req-533944b3-2a69-4b42-b219-5b459c12d135 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0658159 Nov 24 16:06:31.563001 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-da36c406-d8de-4157-b165-1cae00ec91cb req-9e9e6dca-042b-410f-8fbe-f7daad86927f tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/security-groups?id=88ac201e-ff5b-4f61-b70c-6a022b48d436&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0874631 Nov 24 16:06:31.929486 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-320b4ad3-3c53-43dc-a320-cdfb954488ac tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:31.931306 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-320b4ad3-3c53-43dc-a320-cdfb954488ac tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.71 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 946 time: 0.0606368 Nov 24 16:06:32.011516 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:06:32.108399 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60882) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:32.150043 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Deleting port af829109-ec6d-4b1f-b501-099d680019fe {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:06:32.150458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.315630 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-92814615-20be-4808-be3c-45616306041e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.324414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] For port af829109-ec6d-4b1f-b501-099d680019fe, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=af829109-ec6d-4b1f-b501-099d680019fe,segment=NetworkSegment(cfd8620d-0436-44f1-9416-05a3b74c08b2),segment_id=cfd8620d-0436-44f1-9416-05a3b74c08b2)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:32.325275 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.348507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling delete_port for af829109-ec6d-4b1f-b501-099d680019fe owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:06:32.450651 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-92814615-20be-4808-be3c-45616306041e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.457728 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-92814615-20be-4808-be3c-45616306041e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.557054 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92814615-20be-4808-be3c-45616306041e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4cdf355-0885-4d85-a3b9-ba5a786acfa7,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:32.590961 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-92814615-20be-4808-be3c-45616306041e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=ac278f6cd7124f76bbdac07630dbf58b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4806881 Nov 24 16:06:32.595162 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60902) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:32.603883 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.634015 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['af829109-ec6d-4b1f-b501-099d680019fe'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:32.715211 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-162faa18-eb1c-4a70-908c-53781d4b8ee9 req-db52d50d-fe62-495e-be20-62f55ff7717f tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.0347154 Nov 24 16:06:32.724184 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Pushing event deleted for resources: {'Port': ['ID=af829109-ec6d-4b1f-b501-099d680019fe,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:32.856908 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] No DVR routers for this DVR port af829109-ec6d-4b1f-b501-099d680019fe on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:06:32.860757 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.864580 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 req-95b235dc-4990-44db-abf1-46cff7be34dc tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.71 "DELETE /v2.0/ports/af829109-ec6d-4b1f-b501-099d680019fe HTTP/1.1" status: 204 len: 173 time: 0.9204693 Nov 24 16:06:32.866341 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'name': 'network-vif-deleted', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:32.869365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22604d9f-a7ed-4722-9d8a-931d11a395c1" -d '{"events": [{"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-deleted", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:32.891585 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7829000-28c2-4912-9eee-44277ea58a59 req-83f54622-0b1f-4d24-9b82-d0c4229027d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:32.893535 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e7829000-28c2-4912-9eee-44277ea58a59 req-83f54622-0b1f-4d24-9b82-d0c4229027d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.2875042 Nov 24 16:06:32.913544 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:32.959090 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.038289 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e7829000-28c2-4912-9eee-44277ea58a59 req-1c7d7779-1020-4efa-a66f-d724a31427ee tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1100154 Nov 24 16:06:33.077498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60918) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:33.086197 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.089172 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.094385 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b4cdf355-0885-4d85-a3b9-ba5a786acfa7 HTTP/1.1" status: 204 len: 168 time: 0.4977963 Nov 24 16:06:33.097470 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a84d6aa-419c-487b-b355-1bbff0694bac x-openstack-request-id: req-3a84d6aa-419c-487b-b355-1bbff0694bac {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:33.098077 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-deleted", "tag": "af829109-ec6d-4b1f-b501-099d680019fe", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:33.098362 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-3a84d6aa-419c-487b-b355-1bbff0694bac {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:33.098904 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4070b904-d207-48f3-b522-209d11d5291c', 'name': 'network-vif-deleted', 'tag': 'af829109-ec6d-4b1f-b501-099d680019fe', 'status': 'completed', 'code': 200} Nov 24 16:06:33.109135 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee92831-8db8-4e0e-a03c-df526cb0e291 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4cdf355-0885-4d85-a3b9-ba5a786acfa7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:33.240628 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-59489820-b33b-4bbe-a41a-0f523aeb4d28 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.379460 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-59489820-b33b-4bbe-a41a-0f523aeb4d28 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.383797 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-59489820-b33b-4bbe-a41a-0f523aeb4d28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.426622 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-59489820-b33b-4bbe-a41a-0f523aeb4d28 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1ef3dd6b2ea6484596c12b15f7cbc4d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3474503 Nov 24 16:06:33.429465 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60930) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:33.436697 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59489820-b33b-4bbe-a41a-0f523aeb4d28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d9bcca1-5ce0-4f9a-8bfb-92a1289d4e97,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:33.508796 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.546255 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60932) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:33.552775 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.568262 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-40236590-7421-4116-b0c5-b7fe7e4d3fb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.654589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.658492 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.659932 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6d9bcca1-5ce0-4f9a-8bfb-92a1289d4e97 HTTP/1.1" status: 204 len: 168 time: 0.2293465 Nov 24 16:06:33.672125 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bf2bff-a1b4-40ba-8672-a60ddd1698e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d9bcca1-5ce0-4f9a-8bfb-92a1289d4e97,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:33.680962 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-40236590-7421-4116-b0c5-b7fe7e4d3fb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.690463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-40236590-7421-4116-b0c5-b7fe7e4d3fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.739209 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-40236590-7421-4116-b0c5-b7fe7e4d3fb3 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=55712aa81562475d99d58298bfe32639&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1913514 Nov 24 16:06:33.740109 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40236590-7421-4116-b0c5-b7fe7e4d3fb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=331a5d8f-480f-402b-898f-21c38819226a,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:33.743147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60936) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:33.824163 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.857455 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.926941 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a625482d-9a46-4f00-a86c-cd334caa32fa req-6fc253ac-08ce-4e18-9327-8ccb60b32ca3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /v2.0/ports?device_id=4070b904-d207-48f3-b522-209d11d5291c HTTP/1.1" status: 200 len: 210 time: 0.0369363 Nov 24 16:06:33.995078 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.998221 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:33.999615 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/331a5d8f-480f-402b-898f-21c38819226a HTTP/1.1" status: 204 len: 168 time: 0.2551503 Nov 24 16:06:34.017058 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee190d7-f034-48be-a2db-49b30752a931 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=331a5d8f-480f-402b-898f-21c38819226a,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:34.392840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60956) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:34.410108 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0ea13c06-37f7-48cd-a312-9e4521d55465 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.420939 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 req-32965889-a1e5-4ef1-b396-4e3260fabfb8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:34.444920 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 req-32965889-a1e5-4ef1-b396-4e3260fabfb8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1704097 Nov 24 16:06:34.530277 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 req-4158cd11-01ac-4f51-b665-ea3c7c932f5c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824680 Nov 24 16:06:34.563471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0ea13c06-37f7-48cd-a312-9e4521d55465 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.570722 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0ea13c06-37f7-48cd-a312-9e4521d55465 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.617880 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0ea13c06-37f7-48cd-a312-9e4521d55465 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d94e41501fa8401f84a8649b3c40df6a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2184505 Nov 24 16:06:34.617880 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea13c06-37f7-48cd-a312-9e4521d55465 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfd5191e-0d5e-4d1a-b2ef-41abc3b64962,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:34.618269 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60958) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:34.690813 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.691421 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 60960) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:34.711013 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-460c11d8-6564-4767-8759-00088b61558e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.722166 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.817333 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.828966 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.842866 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/dfd5191e-0d5e-4d1a-b2ef-41abc3b64962 HTTP/1.1" status: 204 len: 168 time: 0.2190735 Nov 24 16:06:34.862177 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f9051e-5735-4fe1-b2a8-51c00b96f563 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfd5191e-0d5e-4d1a-b2ef-41abc3b64962,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:34.875691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-460c11d8-6564-4767-8759-00088b61558e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.887158 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-460c11d8-6564-4767-8759-00088b61558e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:34.958930 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-460c11d8-6564-4767-8759-00088b61558e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f409e54ae2fe4adeb5b4278d01cacbbd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2662437 Nov 24 16:06:34.960355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460c11d8-6564-4767-8759-00088b61558e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99c1bf28-f153-4d85-8dad-832ee272795c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:34.962042 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 60964) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:35.055058 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:35.085873 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:35.177833 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:35.185363 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:35.191655 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/99c1bf28-f153-4d85-8dad-832ee272795c HTTP/1.1" status: 204 len: 168 time: 0.2261102 Nov 24 16:06:35.203796 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2777e1b6-f2cd-453e-bf22-9cf36833acf9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99c1bf28-f153-4d85-8dad-832ee272795c,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:35.716177 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 req-9b160dcb-e9b3-4bc6-ab65-ef86b7ed5487 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:35.719146 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 req-9b160dcb-e9b3-4bc6-ab65-ef86b7ed5487 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0789981 Nov 24 16:06:35.787373 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 req-c57735e5-348a-41b4-aa64-7db09f586b8f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634799 Nov 24 16:06:36.016037 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-1e85a5ea-89e1-4d5a-b382-2e146e76b5d2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:36.018806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-1e85a5ea-89e1-4d5a-b382-2e146e76b5d2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.1689279 Nov 24 16:06:36.039986 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-a15ed204-86f1-4dfc-bc17-906fc1e5a47e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/quotas/20c9176ab8ef44ffb17eda5f41aca2a8 HTTP/1.1" status: 200 len: 375 time: 0.0155582 Nov 24 16:06:36.099739 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-ae85b322-8373-4f87-bf7f-3a24e0a1acbe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0588508 Nov 24 16:06:36.219802 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-cfc5b593-592e-4736-9e9d-935a06d25734 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1100261 Nov 24 16:06:36.572765 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-0d523480-a966-4369-a1b3-7e23f7a500f4 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3460369 Nov 24 16:06:36.777876 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 32836) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:36.815971 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device af829109-ec6d-4b1f-b501-099d680019fe no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:06:36.882172 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Deleting subnet 73ce2b53-9439-498a-9f86-2224119f5b5b {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:06:36.887940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: af829109-ec6d-4b1f-b501-099d680019fe {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:06:36.893995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device af829109-ec6d-4b1f-b501-099d680019fe not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:06:36.894243 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:36.941407 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ca44cc4-0b76-4a6a-90fe-0cd36cc90f32 req-243a0f37-d972-4e53-9c7f-5480f638dbe5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 210 time: 0.0491343 Nov 24 16:06:37.014552 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.025500 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea req-45454ecf-e039-4e62-9f91-2cd125951977 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:37.027985 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea req-45454ecf-e039-4e62-9f91-2cd125951977 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1357269 Nov 24 16:06:37.043014 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.144592 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea req-effb38fd-ca38-4fa1-abac-afe47d56c341 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040347 Nov 24 16:06:37.179625 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.216775 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=73ce2b53-9439-498a-9f86-2224119f5b5b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:37.228648 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.237084 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b1b215c8-1ba3-4e8b-9a2a-3d5bc834fc1e admin admin] 10.222.0.72 "DELETE /v2.0/subnets/73ce2b53-9439-498a-9f86-2224119f5b5b HTTP/1.1" status: 204 len: 168 time: 0.4551089 Nov 24 16:06:37.238557 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 32864) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:37.326271 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.452174 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.477129 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.477589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.478606 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.478861 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > port after_create 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.479217 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > port after_delete 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.479575 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > port after_update 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.480610 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.481216 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.481558 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.481915 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.709787 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.710954 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.711500 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.712837 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102787) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:06:37.713406 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3a3f8b84-e6ed-4689-a795-ab7b4d769ab7']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:37.736270 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cfd8620d-0436-44f1-9416-05a3b74c08b2') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:37.736563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cfd8620d-0436-44f1-9416-05a3b74c08b2') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:06:37.758999 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.794251 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.814923 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Releasing vlan 1036 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:06:37.815658 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: from cryptography.utils import int_from_bytes Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: from cryptography.utils import int_from_bytes Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:06:37.846442 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:06:37.924189 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.941374 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Pushing event deleted for resources: {'Network': ['ID=3a3f8b84-e6ed-4689-a795-ab7b4d769ab7,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:37.943407 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:37.950313 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7e185274-e8e9-499f-82bf-4d029083a86a admin admin] 10.222.0.72 "DELETE /v2.0/networks/3a3f8b84-e6ed-4689-a795-ab7b4d769ab7 HTTP/1.1" status: 204 len: 168 time: 0.7084725 Nov 24 16:06:38.100498 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-98383a38-06ef-468a-9376-7e601af7d52e req-e79c2444-5b21-4d0d-8b7e-608c7205ff02 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 210 time: 0.0417807 Nov 24 16:06:38.277963 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 32932) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:38.398860 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c9de70-d011-41f8-b962-306f4c962148 req-addcf8ef-11e9-48ce-b7e0-4eb7bd97187a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:38.403140 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-40c9de70-d011-41f8-b962-306f4c962148 req-addcf8ef-11e9-48ce-b7e0-4eb7bd97187a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1439192 Nov 24 16:06:38.409721 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 32934) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:38.410325 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-37e63162-6cc9-4b63-a6b7-adba47cb8603 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c127095ad8cc41098ef0dd79f4fcd589&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1302061 Nov 24 16:06:38.435485 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 32936) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:38.461269 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-528b965d-55be-4b88-bcd2-d2b91aa42be9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:38.463272 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-528b965d-55be-4b88-bcd2-d2b91aa42be9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.2228050 Nov 24 16:06:38.484831 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-40c9de70-d011-41f8-b962-306f4c962148 req-b2d99163-efff-42c9-ba4a-8506b483ec3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733364 Nov 24 16:06:38.485979 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Request body: {'port': {'device_id': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'admin_state_up': True, 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:06:38.585095 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.625093 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.713496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:06:38.720763 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.739179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.741992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.743195 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/88ac201e-ff5b-4f61-b70c-6a022b48d436 HTTP/1.1" status: 204 len: 168 time: 0.3315685 Nov 24 16:06:38.762284 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6315c31c-6044-4d9e-b77e-9106790ef605 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88ac201e-ff5b-4f61-b70c-6a022b48d436,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:38.838878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4fdd6e5-a378-4c57-be95-4b8471a6c874 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:38.950370 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Allocated IP 172.20.0.10 (fafb4435-765d-4616-9638-8248f7ef836b/d3e375f9-d96e-4117-a4ce-55baac3893ba/3fa4f539-3c48-40d2-a56f-0717a9dc7259) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:06:39.171560 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4fdd6e5-a378-4c57-be95-4b8471a6c874 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.238939 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4fdd6e5-a378-4c57-be95-4b8471a6c874 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.314316 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c4fdd6e5-a378-4c57-be95-4b8471a6c874 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=9afe3ccb5e6a48e9be436470fd7150c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8771513 Nov 24 16:06:39.315228 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 32970) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:39.333419 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35436a09-4200-4893-aa21-bfd0bf5b5a63 req-2f079542-5224-4d96-91e0-26bf2947a8d7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 210 time: 0.0970309 Nov 24 16:06:39.386666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fdd6e5-a378-4c57-be95-4b8471a6c874 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bd913ba-ac84-4565-90f3-bb0c0b62c61b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:39.402810 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.416066 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.467413 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.467656 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.484485 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:39.530465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Network fafb4435-765d-4616-9638-8248f7ef836b is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:06:39.534986 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:06:39.549671 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:06:39.551627 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.557405 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.561829 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7bd913ba-ac84-4565-90f3-bb0c0b62c61b HTTP/1.1" status: 204 len: 168 time: 0.2443378 Nov 24 16:06:39.570914 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:39.575383 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.589720 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4537063-4836-40fc-abda-a525c83622af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bd913ba-ac84-4565-90f3-bb0c0b62c61b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:39.603670 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event updated for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:39.612832 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-5dc168ad-6688-4ccc-8504-e210155e6c3a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1359096 Nov 24 16:06:39.630204 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Request body: {'port': {'device_id': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:06:39.688646 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a950d59d-811f-44d7-a7b5-e519540a753b req-33af20d1-848a-403b-ac00-fbb6198d8048 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:39.690526 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a950d59d-811f-44d7-a7b5-e519540a753b req-33af20d1-848a-403b-ac00-fbb6198d8048 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0759168 Nov 24 16:06:39.774115 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:39.798080 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a950d59d-811f-44d7-a7b5-e519540a753b req-2233ecbe-01cb-4ca5-ae0f-ae15105b1eba tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974610 Nov 24 16:06:40.075422 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 32998) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:40.092144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9394f5d2-1060-4435-9615-017297bfd0d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.150485 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3fa4f539-3c48-40d2-a56f-0717a9dc7259 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:06:40.170409 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.187372 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Transition to ACTIVE for port object 3fa4f539-3c48-40d2-a56f-0717a9dc7259 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:06:40.193380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.258367 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Pushing event updated for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:40.263304 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9394f5d2-1060-4435-9615-017297bfd0d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.270246 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9394f5d2-1060-4435-9615-017297bfd0d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.304233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Attempting to bind port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:06:40.304571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Attempting to bind port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:06:40.304930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Attempting to bind port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:06:40.310285 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 on network fafb4435-765d-4616-9638-8248f7ef836b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:06:40.310608 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Attempting to bind port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:06:40.316790 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 6, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:06:40.316790 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Checking segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:06:40.317270 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Bound using segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:06:40.318417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Bound port: 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:06:40.318417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.328238 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9394f5d2-1060-4435-9615-017297bfd0d1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c232e7f3fa6b4dc89d911fb5c56488f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2479470 Nov 24 16:06:40.328238 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9394f5d2-1060-4435-9615-017297bfd0d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a20645c-de74-4b41-874e-56c85937b48d,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:40.328845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33004) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:40.405319 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:06:40.409307 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.409658 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:06:40.424634 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.438512 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.501181 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.505905 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.506558 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:40.507247 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:40.508815 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] 10.222.0.71 "PUT /v2.0/ports/3fa4f539-3c48-40d2-a56f-0717a9dc7259 HTTP/1.1" status: 200 len: 1094 time: 0.8871820 Nov 24 16:06:40.510299 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6a20645c-de74-4b41-874e-56c85937b48d HTTP/1.1" status: 204 len: 168 time: 0.1800573 Nov 24 16:06:40.514724 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:40.518067 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-732d9a5d-ce83-4e95-9be9-2225322a8c7b" -d '{"events": [{"name": "network-changed", "server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:40.525255 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e2e02c-fc56-464a-9c99-7fa8982f841b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a20645c-de74-4b41-874e-56c85937b48d,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:40.588376 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c706555-7581-4ee3-bb60-5731e4e50c60 req-0cc81ac7-7fc2-4ff5-bf96-20c10d9d24ad tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:40.596211 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3c706555-7581-4ee3-bb60-5731e4e50c60 req-0cc81ac7-7fc2-4ff5-bf96-20c10d9d24ad tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.1635661 Nov 24 16:06:40.599399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579ca56b-5c24-485f-aa62-9b00492c2f3b service neutron] Pushing event updated for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:40.649504 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8752c753-6812-4bc9-b948-c2024a206016 x-openstack-request-id: req-8752c753-6812-4bc9-b948-c2024a206016 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:40.649814 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:40.650075 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8752c753-6812-4bc9-b948-c2024a206016 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:40.650578 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'status': 'completed', 'code': 200} Nov 24 16:06:40.741519 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3c706555-7581-4ee3-bb60-5731e4e50c60 req-d6099cea-0b1a-4f44-a5fa-fc93c8ab5d66 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439352 Nov 24 16:06:40.752293 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-f33fdf21-eb24-49fb-9a63-95d8b5dd0804 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:40.754483 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-f33fdf21-eb24-49fb-9a63-95d8b5dd0804 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 1097 time: 0.1560156 Nov 24 16:06:40.842708 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-679a0095-9d53-4cc0-9981-c6f06344c116 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259 HTTP/1.1" status: 200 len: 217 time: 0.0777400 Nov 24 16:06:40.928856 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172973d2-e069-4965-8818-20e4662bd3e2 req-dac5a18c-47af-4305-9ed7-ac225b6b9331 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:40.930570 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-dac5a18c-47af-4305-9ed7-ac225b6b9331 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0742843 Nov 24 16:06:41.025367 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-875fbd3d-fbd5-4f24-93a7-312892aa6624 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0658622 Nov 24 16:06:41.055991 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c62133-9e0d-4198-bf2e-f7e1b38033de req-2bfd5266-7b77-4248-b2c5-4deafa367a65 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:41.058500 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-24c62133-9e0d-4198-bf2e-f7e1b38033de req-2bfd5266-7b77-4248-b2c5-4deafa367a65 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0890460 Nov 24 16:06:41.129240 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-24c62133-9e0d-4198-bf2e-f7e1b38033de req-f323987a-9ae0-4f54-bbbf-f32b1de52e56 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640297 Nov 24 16:06:41.186373 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-f9f61b1b-ff91-4cb8-b8b0-eea4250bbec0 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1401374 Nov 24 16:06:41.324960 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-172973d2-e069-4965-8818-20e4662bd3e2 req-fc83b8b8-7c44-42ff-bb80-ac963a6344bc service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229560 Nov 24 16:06:41.466457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-faf5a9d8-f480-4a09-9e84-f21bc0d8d7d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:41.468231 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-faf5a9d8-f480-4a09-9e84-f21bc0d8d7d9 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 1097 time: 0.0481565 Nov 24 16:06:41.617193 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-b575b41c-aaa8-4d39-b62a-ca7968425291 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:41.621459 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-b575b41c-aaa8-4d39-b62a-ca7968425291 service neutron] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 917 time: 0.1389935 Nov 24 16:06:41.696029 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-332ca749-eeca-4b07-b8c3-21542ffe0e65 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259 HTTP/1.1" status: 200 len: 217 time: 0.0609732 Nov 24 16:06:41.776063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8076243d-7431-465f-92e6-567c70feb36b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:41.777892 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8076243d-7431-465f-92e6-567c70feb36b service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0739572 Nov 24 16:06:41.848623 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-c1386033-4d8b-4bad-8471-3117b2c51edd service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0574880 Nov 24 16:06:41.899114 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb req-cb4c674c-37ed-4048-8b51-ede39e393f3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:41.907911 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb req-cb4c674c-37ed-4048-8b51-ede39e393f3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.0733628 Nov 24 16:06:42.018251 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb req-53adba0c-05f6-48e5-a409-0e30aa11f24f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053534 Nov 24 16:06:42.045665 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-ba0c4e3a-0f5e-4cd1-9a2a-9d051fa361e7 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1830156 Nov 24 16:06:42.273927 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-df13311e-ded4-4512-b149-0829fa6492ad service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2146988 Nov 24 16:06:42.401010 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c120077-b672-475c-9675-bdf6d00c9d71 req-5ecbf16a-bc3c-441c-832d-edd668c0ec56 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:42.407516 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c120077-b672-475c-9675-bdf6d00c9d71 req-5ecbf16a-bc3c-441c-832d-edd668c0ec56 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0831316 Nov 24 16:06:42.515971 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c120077-b672-475c-9675-bdf6d00c9d71 req-78c3990c-e7ac-4474-a2e7-49d3a7b7db3d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991402 Nov 24 16:06:43.218518 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a req-75010a10-e02c-4c48-8c21-22c51effce43 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:43.223552 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a req-75010a10-e02c-4c48-8c21-22c51effce43 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.0870268 Nov 24 16:06:43.298303 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a req-94a19ebc-e69a-4d85-bb61-45f01f56a1a9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683401 Nov 24 16:06:43.682068 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b req-065617a7-b3e5-45f6-9c2c-dcc5a154f1fa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:43.685426 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b req-065617a7-b3e5-45f6-9c2c-dcc5a154f1fa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0871427 Nov 24 16:06:43.736928 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b req-6cbafe99-679e-4f56-9c8b-cb4935dd9685 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452909 Nov 24 16:06:43.787771 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:44.433513 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34fe11ff-f33b-4784-9003-f6823807306f req-8e2be228-3701-4000-9273-a72fa67441ab tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:44.435545 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-34fe11ff-f33b-4784-9003-f6823807306f req-8e2be228-3701-4000-9273-a72fa67441ab tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.0633214 Nov 24 16:06:44.487005 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-34fe11ff-f33b-4784-9003-f6823807306f req-3c3dd713-a800-45b6-8ade-ee29b1979ac8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456276 Nov 24 16:06:44.868817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f229ee-d370-43e0-9d6f-81bfaba414fe req-d12c8b71-20a7-419a-894b-972026e70ef2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:44.870548 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f2f229ee-d370-43e0-9d6f-81bfaba414fe req-d12c8b71-20a7-419a-894b-972026e70ef2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0542994 Nov 24 16:06:44.924406 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f2f229ee-d370-43e0-9d6f-81bfaba414fe req-b840e670-89b0-4431-87f5-3869295b8c18 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479910 Nov 24 16:06:45.619786 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2abfc2c-256c-4490-ba66-1d7d17142f37 req-829c380c-5294-42e8-8451-a60ea858fbfb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:45.622242 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2abfc2c-256c-4490-ba66-1d7d17142f37 req-829c380c-5294-42e8-8451-a60ea858fbfb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.0584183 Nov 24 16:06:45.682135 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2abfc2c-256c-4490-ba66-1d7d17142f37 req-6e4b278f-dd1f-4734-b733-d63245c1dd7e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536244 Nov 24 16:06:46.055567 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe req-57b94972-62de-414a-a635-b21ef41c5ab5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:46.057223 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe req-57b94972-62de-414a-a635-b21ef41c5ab5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0546863 Nov 24 16:06:46.129279 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe req-0fcb1a8a-ffe5-4803-aea0-291f8e736cb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604162 Nov 24 16:06:46.816800 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63e403a-17c8-4e90-9870-6926ef28696f req-dd63fe08-bfb5-463b-8fef-074c99f1e736 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:46.818344 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d63e403a-17c8-4e90-9870-6926ef28696f req-dd63fe08-bfb5-463b-8fef-074c99f1e736 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 944 time: 0.0549376 Nov 24 16:06:46.834144 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3fa4f539-3c48-40d2-a56f-0717a9dc7259 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:06:46.883025 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d63e403a-17c8-4e90-9870-6926ef28696f req-23b7031a-95a8-45a2-a315-47411e0a2e96 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566621 Nov 24 16:06:46.960818 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:46.973725 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'port_id': '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'mac_address': 'fa:16:3e:30:85:72', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3e375f9-d96e-4117-a4ce-55baac3893ba', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:06:47.024860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.039893 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3fa4f539-3c48-40d2-a56f-0717a9dc7259 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:06:47.060800 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:47.065887 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.123741 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:47.282078 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb req-fe5d5e85-88d9-4a6b-8ace-e919362e0e90 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:47.283606 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb req-fe5d5e85-88d9-4a6b-8ace-e919362e0e90 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0557477 Nov 24 16:06:47.333785 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33292) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:47.340639 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb req-64982b77-77f4-4e06-a2d7-c6652f926221 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508046 Nov 24 16:06:47.460331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6a7a0e7-3ff7-44e4-a19a-62528b61d708 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.568521 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6a7a0e7-3ff7-44e4-a19a-62528b61d708 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.577713 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6a7a0e7-3ff7-44e4-a19a-62528b61d708 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.619445 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['3fa4f539-3c48-40d2-a56f-0717a9dc7259'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:06:47.639229 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e6a7a0e7-3ff7-44e4-a19a-62528b61d708 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=99231eed4df2457ba25d8e5ddd96af18&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3037386 Nov 24 16:06:47.640097 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33304) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:47.641262 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a7a0e7-3ff7-44e4-a19a-62528b61d708 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e0babed-ceca-492e-b88e-f124a5128294,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:47.700562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.724844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.790669 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.794844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:47.797566 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/2e0babed-ceca-492e-b88e-f124a5128294 HTTP/1.1" status: 204 len: 168 time: 0.1560075 Nov 24 16:06:47.814926 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6345cc26-d96d-4f3d-8f37-89d7ba1aff6e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e0babed-ceca-492e-b88e-f124a5128294,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:48.011493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33318) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:48.093044 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514f9e44-6be3-4ca0-bb65-ad862f56e997 req-c8ba96bb-2ef0-4623-b7e3-12b984eb7b6c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:48.094635 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-514f9e44-6be3-4ca0-bb65-ad862f56e997 req-c8ba96bb-2ef0-4623-b7e3-12b984eb7b6c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 945 time: 0.0927410 Nov 24 16:06:48.157934 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-514f9e44-6be3-4ca0-bb65-ad862f56e997 req-72638034-f278-4f32-8825-7ee6a5f2f175 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566049 Nov 24 16:06:48.188129 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c499da98-4a0b-4e67-9474-a883afad771c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.195290 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33326) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:48.210694 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-88c1e95a-7578-4a8d-bc06-05eda3f518dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.288784 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c499da98-4a0b-4e67-9474-a883afad771c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.295400 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c499da98-4a0b-4e67-9474-a883afad771c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.312227 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-88c1e95a-7578-4a8d-bc06-05eda3f518dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.317820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-88c1e95a-7578-4a8d-bc06-05eda3f518dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.341769 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c499da98-4a0b-4e67-9474-a883afad771c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fe1d446-d9b2-4384-bee4-d40f17d88f26,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:48.349744 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c499da98-4a0b-4e67-9474-a883afad771c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=488a6eeabef94d61a6b1286c678ae245&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3367734 Nov 24 16:06:48.352528 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33328) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:48.363884 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-88c1e95a-7578-4a8d-bc06-05eda3f518dd admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1b183750196c4802b3f2defa56e03316&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1660600 Nov 24 16:06:48.364790 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c1e95a-7578-4a8d-bc06-05eda3f518dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efa24cf2-5553-4452-871d-2ee7d5ce0e68,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:48.367991 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33330) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:48.425472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.436546 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.450691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.465130 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.530297 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.533172 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.534306 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/efa24cf2-5553-4452-871d-2ee7d5ce0e68 HTTP/1.1" status: 204 len: 168 time: 0.1652281 Nov 24 16:06:48.547062 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.552155 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.555954 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4fe1d446-d9b2-4384-bee4-d40f17d88f26 HTTP/1.1" status: 204 len: 168 time: 0.1996341 Nov 24 16:06:48.562581 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbea0043-ae83-41f5-adf4-bdbd4853f770 req-537a91a7-1a55-45c0-9764-342d048b077e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:48.564411 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee649e7-441f-415f-bd89-8ca932226685 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fe1d446-d9b2-4384-bee4-d40f17d88f26,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:48.564580 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bbea0043-ae83-41f5-adf4-bdbd4853f770 req-537a91a7-1a55-45c0-9764-342d048b077e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0932839 Nov 24 16:06:48.565729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b668113d-ebe4-46d3-baf9-0f4ab754e3ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efa24cf2-5553-4452-871d-2ee7d5ce0e68,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:48.618247 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2ff17326-4135-4418-b73f-384d4fd2be62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:48.628212 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bbea0043-ae83-41f5-adf4-bdbd4853f770 req-f77aaeff-c332-43fb-afea-8c1f4c8cbc6f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559838 Nov 24 16:06:49.022107 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33346) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:49.034770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33348) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:49.037266 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3836f42c-c58f-4a6b-8802-98175602a62d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.049899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f2936483-7804-4221-9f16-6368a1381ebc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.128309 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3836f42c-c58f-4a6b-8802-98175602a62d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.133169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3836f42c-c58f-4a6b-8802-98175602a62d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.142020 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f2936483-7804-4221-9f16-6368a1381ebc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.148845 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f2936483-7804-4221-9f16-6368a1381ebc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.178780 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3836f42c-c58f-4a6b-8802-98175602a62d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6c4839e-1406-46ad-bf1c-188c5430d82a,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:49.186652 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3836f42c-c58f-4a6b-8802-98175602a62d admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=28783f6849484391be628db7c239e358&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1632586 Nov 24 16:06:49.187356 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33354) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:49.197729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2936483-7804-4221-9f16-6368a1381ebc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c91eea4-aa83-4dd7-8f6f-e4ae492031a6,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:49.204080 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f2936483-7804-4221-9f16-6368a1381ebc admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d5fe2e9761dc4817a022b15652d22cc5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1677878 Nov 24 16:06:49.207075 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33356) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:49.259653 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.291503 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.300880 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.334596 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.358169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.362027 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.366442 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c6c4839e-1406-46ad-bf1c-188c5430d82a HTTP/1.1" status: 204 len: 168 time: 0.1747692 Nov 24 16:06:49.371088 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 req-6040a852-49a6-4044-8e1a-b38e3eb6ffd9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:49.373134 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 req-6040a852-49a6-4044-8e1a-b38e3eb6ffd9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 945 time: 0.0926945 Nov 24 16:06:49.376211 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-724f11f2-7714-4530-8f87-c95590a4c2a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6c4839e-1406-46ad-bf1c-188c5430d82a,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:49.429179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.431887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:49.433292 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/2c91eea4-aa83-4dd7-8f6f-e4ae492031a6 HTTP/1.1" status: 204 len: 168 time: 0.2250214 Nov 24 16:06:49.451148 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 req-3e6e8b04-7e16-4362-851f-a2aaaf7e8bc2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663660 Nov 24 16:06:49.456278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef793eb-674e-4bf1-a47c-25851d1448e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c91eea4-aa83-4dd7-8f6f-e4ae492031a6,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:49.868642 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7dbd104-8812-4293-814c-4c283942dc07 req-09a94615-aa40-4a2e-b23b-823d12fecab3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:49.871271 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f7dbd104-8812-4293-814c-4c283942dc07 req-09a94615-aa40-4a2e-b23b-823d12fecab3 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 1098 time: 0.1169860 Nov 24 16:06:49.899838 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69461eee-c26d-47c2-9e53-dbad1949213f req-51956bb2-b12a-47cd-9b38-dfa62f5023b4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:49.906356 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69461eee-c26d-47c2-9e53-dbad1949213f req-51956bb2-b12a-47cd-9b38-dfa62f5023b4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.1099067 Nov 24 16:06:49.977166 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 33380) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:49.978230 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f7dbd104-8812-4293-814c-4c283942dc07 req-64a93fdd-2ef5-4a9d-aa46-d76fc79e60b3 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975416 Nov 24 16:06:49.986642 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69461eee-c26d-47c2-9e53-dbad1949213f req-d83e938b-4bd5-45e9-9e99-76ea27775791 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784228 Nov 24 16:06:49.991190 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7a6eac9e-d7c2-404d-9b80-b7afcc72bac1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.071426 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7a6eac9e-d7c2-404d-9b80-b7afcc72bac1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.077726 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7a6eac9e-d7c2-404d-9b80-b7afcc72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.120290 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7a6eac9e-d7c2-404d-9b80-b7afcc72bac1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5209201de36b425681a49a963fef64ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1420014 Nov 24 16:06:50.121461 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6eac9e-d7c2-404d-9b80-b7afcc72bac1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61034f30-9ac4-463b-a033-b8d081a70804,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:50.122923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 33384) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:06:50.177543 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.200052 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.254778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.257443 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:50.258577 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/61034f30-9ac4-463b-a033-b8d081a70804 HTTP/1.1" status: 204 len: 168 time: 0.1335793 Nov 24 16:06:50.271026 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b72c4e-eef7-4465-9cc4-d9d695ae9b59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61034f30-9ac4-463b-a033-b8d081a70804,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:50.607559 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03292599-205a-41fd-ab58-c59b363528e6 req-b46803f2-2466-4a2d-baf3-821c1d468e4f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:50.609962 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-03292599-205a-41fd-ab58-c59b363528e6 req-b46803f2-2466-4a2d-baf3-821c1d468e4f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 945 time: 0.0740454 Nov 24 16:06:50.679644 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-03292599-205a-41fd-ab58-c59b363528e6 req-90c83ec5-3020-4633-89cb-a8fb91336489 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630350 Nov 24 16:06:50.869160 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3fa4f539-3c48-40d2-a56f-0717a9dc7259 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:06:50.945783 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:06:50.952575 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:06:50.953198 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:51.041482 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:51.074254 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:06:51.076649 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78677846-c85f-4c8c-b4e9-968b4d19b850" -d '{"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-plugged", "status": "completed", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:06:51.092902 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:06:51.098694 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:51.164426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 req-4382a81d-2d3c-42e1-b8ab-849505b1a35c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:51.168299 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 req-4382a81d-2d3c-42e1-b8ab-849505b1a35c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0905890 Nov 24 16:06:51.175814 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:06:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49101057-9ed7-4aa1-8547-07aab07383ca x-openstack-request-id: req-49101057-9ed7-4aa1-8547-07aab07383ca {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:06:51.176384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-plugged", "status": "completed", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:06:51.176871 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-49101057-9ed7-4aa1-8547-07aab07383ca {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:06:51.177683 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'code': 200} Nov 24 16:06:51.201921 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:06:51.271678 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8ec2a2c5-0516-483f-b279-b93ec9e79e64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:51.281413 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 req-f1c4a598-8d25-4952-90e8-fc6d8de317d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1051295 Nov 24 16:06:51.421063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c6f848-5f3e-457f-9b12-aa1e92186f36 req-36022d2a-50f0-47d1-93ff-aee1fbf8d327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:51.424610 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8c6f848-5f3e-457f-9b12-aa1e92186f36 req-36022d2a-50f0-47d1-93ff-aee1fbf8d327 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 1099 time: 0.0472665 Nov 24 16:06:51.489575 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c8c6f848-5f3e-457f-9b12-aa1e92186f36 req-b99d1b9a-1633-4bda-a365-61a985097b41 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514321 Nov 24 16:06:51.816018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec req-4ac4a3cc-64e2-4f90-afe9-b186c9470393 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:51.817572 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec req-4ac4a3cc-64e2-4f90-afe9-b186c9470393 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.0585213 Nov 24 16:06:51.908872 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec req-b7278f93-4254-4a51-b4ab-1049f96c6b77 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838099 Nov 24 16:06:52.413680 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef req-53ae2b31-5b55-4c42-8186-2b239debdf53 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:52.417357 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef req-53ae2b31-5b55-4c42-8186-2b239debdf53 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0530322 Nov 24 16:06:52.498868 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef req-2993525f-720c-4c2f-b418-558f57ac83e1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741677 Nov 24 16:06:52.614132 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:52.652327 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 req-b75d1274-5d60-4606-a823-8fa1c6ecba0f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:52.655150 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 req-b75d1274-5d60-4606-a823-8fa1c6ecba0f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0610111 Nov 24 16:06:52.719890 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 req-6385d42c-419d-4918-a183-a3a55874ce43 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584199 Nov 24 16:06:53.071556 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d70d06d6-a397-42c1-8ec2-9127dd90b266 req-a6a24f22-b668-420c-bbd0-43482c4bf7e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:53.073399 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d70d06d6-a397-42c1-8ec2-9127dd90b266 req-a6a24f22-b668-420c-bbd0-43482c4bf7e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.0703006 Nov 24 16:06:53.168441 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d70d06d6-a397-42c1-8ec2-9127dd90b266 req-2c5243fb-10b9-4631-9051-e81d4c2af7bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791721 Nov 24 16:06:54.299130 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:54.428671 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:06:59.450278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e2e90e-e668-4266-be93-14dba0bfcd78 req-c48f9b00-f750-4378-b2bb-3a12204748a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:06:59.451781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-66e2e90e-e668-4266-be93-14dba0bfcd78 req-c48f9b00-f750-4378-b2bb-3a12204748a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.0597000 Nov 24 16:06:59.500063 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-66e2e90e-e668-4266-be93-14dba0bfcd78 req-2ccab175-e8aa-49a5-bf99-808ce01a8baf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421391 Nov 24 16:07:09.001270 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:07:10.271777 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4262b8e6-c708-41e3-97dd-a37c14fc203c req-9a1d47cf-888c-4bdc-8018-a8171bd83e38 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:10.273393 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4262b8e6-c708-41e3-97dd-a37c14fc203c req-9a1d47cf-888c-4bdc-8018-a8171bd83e38 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0503175 Nov 24 16:07:10.325104 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4262b8e6-c708-41e3-97dd-a37c14fc203c req-6feb0c54-625e-4c6a-a925-cb6fd1c1e098 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438578 Nov 24 16:07:13.784995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:15.109970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-36490454-26ce-4e1d-bf6a-ffc2ef9d0a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.112916 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-36490454-26ce-4e1d-bf6a-ffc2ef9d0a29 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.0732028 Nov 24 16:07:15.260659 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffba5637-c0d5-4289-bc4a-b49e63b08750 req-6b4c6ab5-f4de-4c94-818e-57ec9f739641 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.262384 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffba5637-c0d5-4289-bc4a-b49e63b08750 req-6b4c6ab5-f4de-4c94-818e-57ec9f739641 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1476338 Nov 24 16:07:15.294411 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-078599f5-a05c-42a6-944a-0eb7d8460d34 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1296985 Nov 24 16:07:15.296739 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-d878db8f-fa4e-4137-8733-33207d870877 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.298132 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-d878db8f-fa4e-4137-8733-33207d870877 service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.1668687 Nov 24 16:07:15.388781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-f8c3b84b-b3a2-4128-9394-42bec3af50da service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.0674772 Nov 24 16:07:15.393774 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffba5637-c0d5-4289-bc4a-b49e63b08750 req-c99a8c93-3eb2-4a47-88d1-8d1ab7ba0a7d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1188064 Nov 24 16:07:15.448236 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-69ed9d16-5762-467d-9d92-7a8cc5ba8561 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.449769 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-69ed9d16-5762-467d-9d92-7a8cc5ba8561 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 1098 time: 0.1209090 Nov 24 16:07:15.456800 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-826e1ff2-514a-4e45-85b9-a94c1d95fdaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.458214 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-826e1ff2-514a-4e45-85b9-a94c1d95fdaa service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.0602436 Nov 24 16:07:15.502968 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-3f147801-6339-4750-a60b-4a0d0a5d70d5 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0371964 Nov 24 16:07:15.852478 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-3573041b-f9bc-45bd-a854-815923061df1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:15.854902 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-3573041b-f9bc-45bd-a854-815923061df1 service neutron] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 917 time: 0.3794374 Nov 24 16:07:15.859089 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-bc9dab1f-bf1f-455e-8c9e-7eb64217f469 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3460388 Nov 24 16:07:15.913048 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-62682801-0561-4162-815e-c8bdb36d71c5 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=691eb29c-951c-4f72-b283-76d5f14e961e HTTP/1.1" status: 200 len: 217 time: 0.0435042 Nov 24 16:07:16.010396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-00aa6de7-de4c-408b-9458-e5218056b575 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:16.011839 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-00aa6de7-de4c-408b-9458-e5218056b575 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0890770 Nov 24 16:07:16.051734 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccca4b14-f42f-42ce-be1c-f66228347655 req-a4c80af1-b8f9-49fe-99d5-136632eb8903 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1761336 Nov 24 16:07:16.055889 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-2305b763-1336-454d-8158-c65954d36446 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0350404 Nov 24 16:07:16.189719 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-64200ead-89d2-4749-a0ff-502f0b461b92 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1205149 Nov 24 16:07:16.323434 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3ce3ccf9-7dc5-422d-89ac-2d4bb752828e req-ef8117da-b7aa-411e-8e86-c088379314a3 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1182382 Nov 24 16:07:16.538118 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-224f196e-27bd-4bf2-94b6-93b43bb73b82 req-65c7bdfc-5ddf-4662-beed-bf8f363560c9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:16.539691 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-224f196e-27bd-4bf2-94b6-93b43bb73b82 req-65c7bdfc-5ddf-4662-beed-bf8f363560c9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0686333 Nov 24 16:07:16.620011 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-224f196e-27bd-4bf2-94b6-93b43bb73b82 req-b1dab0f5-e96b-4bf9-b797-2f1e56dc4fd1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603683 Nov 24 16:07:16.686499 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-c45599a2-795d-42cb-8bd4-c1d6f6ce8ba3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:16.688044 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-c45599a2-795d-42cb-8bd4-c1d6f6ce8ba3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.1380529 Nov 24 16:07:16.707584 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1fd711c8-bc9f-4920-b1f2-183c196397c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/quotas/20c9176ab8ef44ffb17eda5f41aca2a8 HTTP/1.1" status: 200 len: 375 time: 0.0117819 Nov 24 16:07:16.800375 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-968a318e-6b34-43bf-905c-dd9028d4ce8d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0784359 Nov 24 16:07:16.922446 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-b0da874f-92ee-4b3b-8e4e-e235a789add5 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1197813 Nov 24 16:07:17.030110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-5db0bb4b-47bf-47d9-bf77-c96a2ab1b982 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0999932 Nov 24 16:07:17.205424 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3d201a9b-956a-44c8-b0af-f8944c2cd61c req-f16e13ca-9b31-4eb4-9de1-8928b08ed413 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 210 time: 0.0319695 Nov 24 16:07:17.792586 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d5cc3d-0070-4802-baba-71fbb77324f9 req-20d23857-8b56-4678-881a-4f4eac3d9e4a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:17.794306 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91d5cc3d-0070-4802-baba-71fbb77324f9 req-20d23857-8b56-4678-881a-4f4eac3d9e4a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0675654 Nov 24 16:07:17.862833 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91d5cc3d-0070-4802-baba-71fbb77324f9 req-1676bea5-770c-418e-b975-333e9216caa8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617421 Nov 24 16:07:18.317482 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-aab3961c-b376-403e-b54b-a73e95a2d6b9 req-c062cf15-5896-4a7d-a4b3-e639b81c1663 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 210 time: 0.0278027 Nov 24 16:07:18.604321 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9b97d901-0788-4e45-8ac1-f51de3cdd0ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:21.249614 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f5a39258-e554-4154-a716-2c28eec9a5bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:22.632341 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:22.648822 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6019d33b-7fee-4c61-84aa-c6ad4e311133 req-490473e4-5d4c-4e9e-8570-f3a7b2b11465 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:22.652009 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6019d33b-7fee-4c61-84aa-c6ad4e311133 req-490473e4-5d4c-4e9e-8570-f3a7b2b11465 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0805526 Nov 24 16:07:22.687181 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 req-69681bf2-b298-4236-8155-9bf4a96fcac3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 210 time: 0.0284789 Nov 24 16:07:22.710198 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6019d33b-7fee-4c61-84aa-c6ad4e311133 req-13f0b71b-a412-4d1b-909c-32f0e3aa7226 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515132 Nov 24 16:07:23.078762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-19b796bb-ba07-44c3-9909-0479ed9e7bd2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:23.080294 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-19b796bb-ba07-44c3-9909-0479ed9e7bd2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.1355259 Nov 24 16:07:23.103581 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Request body: {'port': {'device_id': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'admin_state_up': True, 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:23.234116 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:23.237571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:23.397002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Allocated IP 172.20.0.6 (fafb4435-765d-4616-9638-8248f7ef836b/d3e375f9-d96e-4117-a4ce-55baac3893ba/f6b62b55-c282-46ef-a9ba-700f74a8fa81) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:23.568606 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:23.606018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:23.643647 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e', '3fa4f539-3c48-40d2-a56f-0717a9dc7259'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:07:23.655161 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Network fafb4435-765d-4616-9638-8248f7ef836b is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:23.658691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:23.663025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:23.669999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:23.670547 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:23.683794 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event updated for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:23.693952 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.694777 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.694777 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.695069 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.695304 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.695655 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.696059 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.696428 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.697525 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.698166 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.698521 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.698851 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:23.706196 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-1b678111-ba3e-47c2-8df9-79a556d9d9c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6072044 Nov 24 16:07:23.721987 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Request body: {'port': {'device_id': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:23.802757 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:23.885495 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b req-f2f3f148-8aee-4161-b2cf-ee4822edb8b4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:23.893454 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b req-f2f3f148-8aee-4161-b2cf-ee4822edb8b4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0751548 Nov 24 16:07:23.920281 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e734253d-44cf-433c-aee8-054c662ca364 req-1e4fae18-e1d6-4065-a2ca-55f578b396e5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:23.922086 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e734253d-44cf-433c-aee8-054c662ca364 req-1e4fae18-e1d6-4065-a2ca-55f578b396e5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 931 time: 0.0934665 Nov 24 16:07:23.947749 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b req-24b523bf-76f5-4036-b076-54a5f1136d58 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530546 Nov 24 16:07:24.057263 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e734253d-44cf-433c-aee8-054c662ca364 req-435517d4-5795-4542-b7a5-25bea7af49aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918553 Nov 24 16:07:24.188334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6b62b55-c282-46ef-a9ba-700f74a8fa81 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:07:24.197569 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.211280 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Transition to ACTIVE for port object f6b62b55-c282-46ef-a9ba-700f74a8fa81 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:07:24.216156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.275101 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Pushing event updated for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:24.315696 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.316606 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Attempting to bind port f6b62b55-c282-46ef-a9ba-700f74a8fa81 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:24.316952 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Attempting to bind port f6b62b55-c282-46ef-a9ba-700f74a8fa81 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:24.317322 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Attempting to bind port f6b62b55-c282-46ef-a9ba-700f74a8fa81 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:24.328912 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Port f6b62b55-c282-46ef-a9ba-700f74a8fa81 on network fafb4435-765d-4616-9638-8248f7ef836b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:07:24.328912 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Attempting to bind port f6b62b55-c282-46ef-a9ba-700f74a8fa81 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:24.330959 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:24.331390 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Checking segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:24.331878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Bound using segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:24.332393 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Bound port: f6b62b55-c282-46ef-a9ba-700f74a8fa81, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:24.332820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.439511 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.445143 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:24.451480 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:24.458551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.545624 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:24.546353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:24.548007 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] 10.222.0.71 "PUT /v2.0/ports/f6b62b55-c282-46ef-a9ba-700f74a8fa81 HTTP/1.1" status: 200 len: 1093 time: 0.8314810 Nov 24 16:07:24.548540 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:07:24.551676 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc" -d '{"events": [{"name": "network-changed", "server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:07:24.629557 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9647e95-d828-4a33-a50c-34eae90c1882 service neutron] Pushing event updated for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:24.680025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-716a4e14-785d-4452-93bb-849bdaa9b336 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:24.685991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-716a4e14-785d-4452-93bb-849bdaa9b336 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 1096 time: 0.0742757 Nov 24 16:07:24.711087 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:07:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 x-openstack-request-id: req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:07:24.711662 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:07:24.711662 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:07:24.711935 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'status': 'completed', 'code': 200} Nov 24 16:07:24.767193 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-ed3ef830-e318-40e1-a6f4-543a0ab601c9 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81 HTTP/1.1" status: 200 len: 217 time: 0.0689094 Nov 24 16:07:24.867724 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-cec4515d-3e43-457a-a0f3-b4d93142ba16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:24.871918 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-cec4515d-3e43-457a-a0f3-b4d93142ba16 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0957129 Nov 24 16:07:24.906876 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-5305dc86-0cd0-4317-a1ae-52b5c48fb7b1 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0258989 Nov 24 16:07:25.062888 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-e5dddf7d-f08e-440d-8522-8225526ad671 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1472712 Nov 24 16:07:25.162641 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 req-d3c295a6-92f8-488f-996f-aa69af327d7e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:25.164255 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 req-d3c295a6-92f8-488f-996f-aa69af327d7e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1155474 Nov 24 16:07:25.214019 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-13259f80-3f1c-4989-811e-a833f895cfb3 req-dea10f4d-1472-4f73-a66d-85535cfbf9ff service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371982 Nov 24 16:07:25.246905 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 req-9abbeac4-54f3-4620-b8d3-6bf916c6f56c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:25.249062 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 req-9abbeac4-54f3-4620-b8d3-6bf916c6f56c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 943 time: 0.0759325 Nov 24 16:07:25.261994 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 req-071da1fa-f860-47eb-9202-f7087d789cad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862050 Nov 24 16:07:25.329940 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 req-7c1eeb5e-411f-48e6-afd1-0efd260ddea9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668745 Nov 24 16:07:25.357097 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-aad065a0-316b-49ac-96f8-9d045bd1d131 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:25.357097 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-aad065a0-316b-49ac-96f8-9d045bd1d131 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 1096 time: 0.0530095 Nov 24 16:07:25.363896 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34054) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:25.476447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-06961253-992a-4c2f-bf29-cf8391aaf01d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:25.479030 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-06961253-992a-4c2f-bf29-cf8391aaf01d service neutron] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 917 time: 0.1091635 Nov 24 16:07:25.503048 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44e52891-3fd4-455f-80c7-69421a75e924 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.534583 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a38538f0-c5ee-4ad0-8a4a-f0d373887d58 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81 HTTP/1.1" status: 200 len: 217 time: 0.0446208 Nov 24 16:07:25.612449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-13a1461b-edbe-4980-90aa-5a712bd4a439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:25.614042 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-13a1461b-edbe-4980-90aa-5a712bd4a439 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0712616 Nov 24 16:07:25.652996 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-bc177747-84d3-4902-b3bd-2843b87c5a33 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0305450 Nov 24 16:07:25.710231 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44e52891-3fd4-455f-80c7-69421a75e924 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.737094 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44e52891-3fd4-455f-80c7-69421a75e924 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.793894 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-44e52891-3fd4-455f-80c7-69421a75e924 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c2d0b9e36e7d4a6998785d6d3ca75a6b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4286873 Nov 24 16:07:25.797514 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34058) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:25.800538 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e52891-3fd4-455f-80c7-69421a75e924 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c7f615e-04ff-4b95-8699-b5040df47590,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:25.814617 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-16d34baa-c302-4652-b1d7-4810c41b3033 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1530235 Nov 24 16:07:25.861463 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.898779 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.930837 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-bd7b57b4-e9de-4bc9-beb1-947245759894 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1068096 Nov 24 16:07:25.962798 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.966751 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:25.971995 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/0c7f615e-04ff-4b95-8699-b5040df47590 HTTP/1.1" status: 204 len: 168 time: 0.1691973 Nov 24 16:07:25.983005 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c7f615e-04ff-4b95-8699-b5040df47590,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:25.992000 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.992354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.992697 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.993077 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.993764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.994100 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.994432 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.994760 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.995273 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.995598 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.996048 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:25.996286 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afae47f6-d8c5-437c-8b50-9cfcac19f62d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:26.287352 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34078) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:26.302032 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6a4f2e42-0433-4328-9cdb-89ca5b3d3599 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.391015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6a4f2e42-0433-4328-9cdb-89ca5b3d3599 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.395858 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6a4f2e42-0433-4328-9cdb-89ca5b3d3599 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.439539 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-6a4f2e42-0433-4328-9cdb-89ca5b3d3599 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=59ab190be9ce4240936d30af8bae241c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1510592 Nov 24 16:07:26.440408 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a4f2e42-0433-4328-9cdb-89ca5b3d3599 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe50ca60-cb2c-4fc6-9e11-5b332255154f,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:26.442258 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34084) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:26.494594 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.517683 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.569229 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.572460 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:26.574011 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/fe50ca60-cb2c-4fc6-9e11-5b332255154f HTTP/1.1" status: 204 len: 168 time: 0.1298690 Nov 24 16:07:26.586717 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be49a44-65ef-402f-860f-cf1bdae39329 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe50ca60-cb2c-4fc6-9e11-5b332255154f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:27.404801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34112) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:27.525789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1481465594-network', 'tenant_id': '121ec25020ef44b88c3a39f5f2e6272c'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:27.555745 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Made reservation on behalf of 121ec25020ef44b88c3a39f5f2e6272c for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:27.558906 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.568550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.651911 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.656883 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.682884 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1001} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:07:27.693105 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=badc6fcb-94eb-4262-8813-13f6031dccc7,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:27.699244 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.699596 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Added segment e389c70b-0393-494e-a5ef-236a61738571 of type vlan for network 4efd686c-40bc-444c-9747-bab40f56f9c5 Nov 24 16:07:27.741743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.770544 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.771697 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:27.772467 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:27.808433 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4024427 Nov 24 16:07:27.811854 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34116) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:27.844909 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Request body: {'subnet': {'network_id': '4efd686c-40bc-444c-9747-bab40f56f9c5', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1481465594-subnet', 'tenant_id': '121ec25020ef44b88c3a39f5f2e6272c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:27.853357 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3426a2-b212-4d00-a988-ac12580896dd admin admin] Pushing event updated for resources: {'Network': ['ID=4efd686c-40bc-444c-9747-bab40f56f9c5,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:27.871282 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 4efd686c-40bc-444c-9747-bab40f56f9c5 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:07:27.877543 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Made reservation on behalf of 121ec25020ef44b88c3a39f5f2e6272c for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:27.879977 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.127562 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.185379 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed727f6a-2faf-4b68-8b60-0a34df7a9d04,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:28.201201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Checking segment: {'id': 'e389c70b-0393-494e-a5ef-236a61738571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1001, 'network_id': '4efd686c-40bc-444c-9747-bab40f56f9c5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:28.201807 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Network hostable DHCP agents. Network: 4efd686c-40bc-444c-9747-bab40f56f9c5, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:07:28.227112 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Network 4efd686c-40bc-444c-9747-bab40f56f9c5 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:07:28.239258 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 4efd686c-40bc-444c-9747-bab40f56f9c5) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:28.243731 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:28.244469 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.248511 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db507700-92b3-48da-85f7-bd4159187f82 None None] Network 4efd686c-40bc-444c-9747-bab40f56f9c5 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:28.262510 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-415ba30f-ca32-4129-939b-6464632d18f0 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4494774 Nov 24 16:07:28.385875 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49000552-6350-448a-baea-6b6a140a1bc7 None None] Network 4efd686c-40bc-444c-9747-bab40f56f9c5 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:28.775279 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34138) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:28.780496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1825898383-network', 'tenant_id': '79d1667cdb1746a6b228a8ed8c4b16b3'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:28.802530 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Made reservation on behalf of 79d1667cdb1746a6b228a8ed8c4b16b3 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:28.805153 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.814508 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.900639 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.905676 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.935445 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1028} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:07:28.943095 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=118ef861-7473-438d-908a-08cf907fb561,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:28.952159 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:28.952559 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Added segment 69755eb1-d460-42be-9075-148d3e55d06c of type vlan for network 7f895734-73a2-4f8e-88b4-6eadbfdf2113 Nov 24 16:07:29.005961 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.034178 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.035061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:29.035670 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.076147 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.2946856 Nov 24 16:07:29.077222 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34142) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:29.084931 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Request body: {'subnet': {'network_id': '7f895734-73a2-4f8e-88b4-6eadbfdf2113', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1825898383-subnet', 'tenant_id': '79d1667cdb1746a6b228a8ed8c4b16b3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:29.107058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2910f024-0d5e-47ea-bc08-27e6c9a45aa9 admin admin] Pushing event updated for resources: {'Network': ['ID=7f895734-73a2-4f8e-88b4-6eadbfdf2113,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:29.129388 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 7f895734-73a2-4f8e-88b4-6eadbfdf2113 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:07:29.141831 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Made reservation on behalf of 79d1667cdb1746a6b228a8ed8c4b16b3 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:29.144503 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.403574 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.494839 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0cc19b1d-2e51-4a54-9914-477c6a864813,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:29.503396 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Checking segment: {'id': '69755eb1-d460-42be-9075-148d3e55d06c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1028, 'network_id': '7f895734-73a2-4f8e-88b4-6eadbfdf2113'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:29.503901 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Network hostable DHCP agents. Network: 7f895734-73a2-4f8e-88b4-6eadbfdf2113, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:07:29.522545 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Network 7f895734-73a2-4f8e-88b4-6eadbfdf2113 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:07:29.533522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 7f895734-73a2-4f8e-88b4-6eadbfdf2113) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:29.538527 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:29.539380 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:29.548890 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d75a063e-d048-4621-af38-b17c36ef0929 None None] Network 7f895734-73a2-4f8e-88b4-6eadbfdf2113 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:29.559273 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3293e96e-c911-4927-b7ce-cad6bef73e14 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4805980 Nov 24 16:07:29.688483 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bfa8897-6d83-42c9-b50b-d61d261b85ab None None] Network 7f895734-73a2-4f8e-88b4-6eadbfdf2113 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:32.749714 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c867eab-9b4c-4873-9761-2efea86afccc req-ddcedd4e-1f42-4fc2-89ee-5ab5fd3c6887 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:32.751572 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7c867eab-9b4c-4873-9761-2efea86afccc req-ddcedd4e-1f42-4fc2-89ee-5ab5fd3c6887 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0534303 Nov 24 16:07:32.758061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43f0508-275b-4480-b674-973fcc7f75ea req-27c5b3d4-82e4-425c-880b-ff9cafc0e669 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:32.760917 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b43f0508-275b-4480-b674-973fcc7f75ea req-27c5b3d4-82e4-425c-880b-ff9cafc0e669 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 943 time: 0.0573027 Nov 24 16:07:32.814486 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7c867eab-9b4c-4873-9761-2efea86afccc req-7f229687-bece-4661-826e-f7e6834b809f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559430 Nov 24 16:07:32.833160 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b43f0508-275b-4480-b674-973fcc7f75ea req-4a7b7424-fd2f-4b7d-9438-9271afb5b3b2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659552 Nov 24 16:07:33.943957 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 req-46915de0-9f9e-49ae-83d8-8bf6bc9e6bbc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:33.945629 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 req-46915de0-9f9e-49ae-83d8-8bf6bc9e6bbc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0511117 Nov 24 16:07:33.990437 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 req-3ee6c21c-5bee-4392-96da-874260527571 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:33.993531 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 req-3ee6c21c-5bee-4392-96da-874260527571 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 943 time: 0.0670731 Nov 24 16:07:34.004452 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 req-e68768f5-6e8a-4bd1-82b8-177752611363 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484099 Nov 24 16:07:34.064126 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 req-58f9f493-371e-40f4-a896-8bf4b9f5d22e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592713 Nov 24 16:07:35.131572 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e req-32f2eedf-5924-40c2-8855-ffe9271a5df0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:35.137380 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e req-32f2eedf-5924-40c2-8855-ffe9271a5df0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0552282 Nov 24 16:07:35.198470 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf78802-cd73-4d06-bca5-acd5b9c49440 req-0c339fb1-2515-43de-8fd1-7f7fea1968e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:35.200017 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2bf78802-cd73-4d06-bca5-acd5b9c49440 req-0c339fb1-2515-43de-8fd1-7f7fea1968e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 943 time: 0.0579441 Nov 24 16:07:35.201057 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e req-fbef00d5-4a6c-49c4-a6c3-b90d275cb404 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610919 Nov 24 16:07:35.491802 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2bf78802-cd73-4d06-bca5-acd5b9c49440 req-2adadb8b-c615-4c8e-a847-d6c77d2caa10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2851677 Nov 24 16:07:36.319695 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0380627e-b145-4802-8b4c-db435face13f req-722fca60-3b3b-449b-ae18-3a02a4a7aff1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:36.321202 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0380627e-b145-4802-8b4c-db435face13f req-722fca60-3b3b-449b-ae18-3a02a4a7aff1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0483010 Nov 24 16:07:36.369963 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0380627e-b145-4802-8b4c-db435face13f req-cc0f9b44-69bc-4cb8-b339-2e46f3f4e044 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421064 Nov 24 16:07:36.633014 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69809b7d-72e3-4ad9-a943-529b5112f8e7 req-e69f7515-5675-4344-bdad-8d4f0d0e4449 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:36.636038 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69809b7d-72e3-4ad9-a943-529b5112f8e7 req-e69f7515-5675-4344-bdad-8d4f0d0e4449 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 943 time: 0.0591431 Nov 24 16:07:36.714676 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69809b7d-72e3-4ad9-a943-529b5112f8e7 req-f0c973d3-4faf-4af1-8bd1-e0525e8d4708 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717630 Nov 24 16:07:37.116896 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f6b62b55-c282-46ef-a9ba-700f74a8fa81 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:07:37.143592 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34274) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:37.272861 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:37.287929 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'port_id': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'mac_address': 'fa:16:3e:5d:b5:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3e375f9-d96e-4117-a4ce-55baac3893ba', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:07:37.296019 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fb33bbd5-8073-4b5d-8cd6-89d18736ff57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.336108 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.363454 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6b62b55-c282-46ef-a9ba-700f74a8fa81 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:07:37.390572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:37.399499 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.407393 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fb33bbd5-8073-4b5d-8cd6-89d18736ff57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.414631 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fb33bbd5-8073-4b5d-8cd6-89d18736ff57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.464311 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:37.472894 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.473292 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.473646 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.473988 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.474321 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.474793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.475089 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.475397 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.475671 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.476006 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.476310 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.476632 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:37.482493 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-fb33bbd5-8073-4b5d-8cd6-89d18736ff57 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=175f21e9c6ea459a90aad178e9946d5a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3372972 Nov 24 16:07:37.485061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34280) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:37.507913 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb33bbd5-8073-4b5d-8cd6-89d18736ff57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c933a07e-bda2-4786-a9f2-39beee991630,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:37.542123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1244b0c-3a0f-4540-956b-37878f60e784 req-4ec12727-262c-4a2a-ac3c-b56e1df72244 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:37.543688 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1244b0c-3a0f-4540-956b-37878f60e784 req-4ec12727-262c-4a2a-ac3c-b56e1df72244 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0826848 Nov 24 16:07:37.543813 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.566613 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.616573 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1244b0c-3a0f-4540-956b-37878f60e784 req-064083d1-0b1f-40fc-a989-4017cb04c1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655897 Nov 24 16:07:37.622740 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.627747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:37.629166 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c933a07e-bda2-4786-a9f2-39beee991630 HTTP/1.1" status: 204 len: 168 time: 0.1430643 Nov 24 16:07:37.640347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8945ba48-17cc-4acf-a38a-a4984c6f80cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c933a07e-bda2-4786-a9f2-39beee991630,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:37.901241 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db165617-5992-4108-aabd-dd6f61c98c86 req-1037fade-48e7-40a5-835b-2d7965f7417b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:37.902872 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-db165617-5992-4108-aabd-dd6f61c98c86 req-1037fade-48e7-40a5-835b-2d7965f7417b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 944 time: 0.0760870 Nov 24 16:07:37.933532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['f6b62b55-c282-46ef-a9ba-700f74a8fa81'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:07:37.979618 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-db165617-5992-4108-aabd-dd6f61c98c86 req-54fe7981-2a2a-4b6b-ab7c-fc837bea8213 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669978 Nov 24 16:07:38.748173 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 req-58326ed7-76b8-4f88-a6eb-25df4f148825 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:38.749821 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 req-58326ed7-76b8-4f88-a6eb-25df4f148825 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0542431 Nov 24 16:07:38.805001 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 req-be9b5047-cf74-451d-821d-0c89b4ffb21a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485768 Nov 24 16:07:39.148168 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848abb7d-7ba8-42d5-925e-32df88629103 req-4805375f-b23b-4ad3-a622-f885ba8e849c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:39.151011 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-848abb7d-7ba8-42d5-925e-32df88629103 req-4805375f-b23b-4ad3-a622-f885ba8e849c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 944 time: 0.0607512 Nov 24 16:07:39.208816 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-848abb7d-7ba8-42d5-925e-32df88629103 req-f41122ea-4b71-45e6-bd0a-ffe9fce456c9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512204 Nov 24 16:07:39.982372 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 req-7aa1fb37-f7fe-4a9a-87a1-05bba8d7f3ca tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:39.984372 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 req-7aa1fb37-f7fe-4a9a-87a1-05bba8d7f3ca tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0609322 Nov 24 16:07:40.046324 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 req-5d1cf683-35bd-494f-93e6-3ba8a0cb90c3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547757 Nov 24 16:07:40.371447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 req-57def38b-4af9-44df-935c-24b80be1b99c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:40.373254 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 req-57def38b-4af9-44df-935c-24b80be1b99c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 944 time: 0.0701699 Nov 24 16:07:40.463029 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 req-30a86508-18a1-4472-b48b-95ccd7189613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707378 Nov 24 16:07:40.628403 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f55f671-f950-4948-82c7-41a1fab9b810 req-46238285-f290-4ef4-9a24-220215987b92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:40.631034 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4f55f671-f950-4948-82c7-41a1fab9b810 req-46238285-f290-4ef4-9a24-220215987b92 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.0611241 Nov 24 16:07:40.707107 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4f55f671-f950-4948-82c7-41a1fab9b810 req-ec67df22-8074-4ee6-b557-8fd9d6a2b221 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656352 Nov 24 16:07:41.169253 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f6b62b55-c282-46ef-a9ba-700f74a8fa81 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:41.196811 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f req-c60cf2e0-b958-4d88-9f98-e80e3eecce35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:41.198898 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f req-c60cf2e0-b958-4d88-9f98-e80e3eecce35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0592139 Nov 24 16:07:41.230642 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port f6b62b55-c282-46ef-a9ba-700f74a8fa81 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:07:41.235998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port f6b62b55-c282-46ef-a9ba-700f74a8fa81 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:41.236445 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:41.277775 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f req-f3c0b2ef-7eff-40bc-9ccf-e101f78383d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628300 Nov 24 16:07:41.346283 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:41.379508 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:07:41.381744 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ef74acd-720c-4f8d-a675-d2ed1bed502e" -d '{"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-plugged", "status": "completed", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:07:41.395932 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:41.402143 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:41.448486 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:07:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ff1abe0-137e-4922-adb0-3b2c8b177326 x-openstack-request-id: req-3ff1abe0-137e-4922-adb0-3b2c8b177326 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:07:41.448783 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-plugged", "status": "completed", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:07:41.449060 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-3ff1abe0-137e-4922-adb0-3b2c8b177326 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:07:41.449466 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'code': 200} Nov 24 16:07:41.461010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:41.641484 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86530617-e7d5-47ee-8c6f-f00655c8142a req-b7c56c1a-2b39-463a-9349-87f3ac042311 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:41.650558 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-86530617-e7d5-47ee-8c6f-f00655c8142a req-b7c56c1a-2b39-463a-9349-87f3ac042311 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0904527 Nov 24 16:07:41.736571 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-86530617-e7d5-47ee-8c6f-f00655c8142a req-169c504c-4681-43b0-ba06-dc0e613ddca7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815580 Nov 24 16:07:41.770295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd37ac7-f790-450b-bf82-ed942e287cd7 req-1c5fc8c8-50e0-4a38-b70a-524f56bb3bad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:41.771947 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8dd37ac7-f790-450b-bf82-ed942e287cd7 req-1c5fc8c8-50e0-4a38-b70a-524f56bb3bad service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 1098 time: 0.0845883 Nov 24 16:07:41.808299 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34396) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:41.858609 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8dd37ac7-f790-450b-bf82-ed942e287cd7 req-d77385ed-5294-4624-8cab-a421d5c2e9ca service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782080 Nov 24 16:07:41.869901 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34400) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:41.942812 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ee9838c-6840-4964-926a-730747b41990 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:41.944743 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9234f94-ce52-4c2b-8627-5112bbd80ad7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.085465 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9234f94-ce52-4c2b-8627-5112bbd80ad7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.091723 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ee9838c-6840-4964-926a-730747b41990 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.092843 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9234f94-ce52-4c2b-8627-5112bbd80ad7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.108917 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ee9838c-6840-4964-926a-730747b41990 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.153069 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9234f94-ce52-4c2b-8627-5112bbd80ad7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94c2c5cd-6288-4c19-987b-3c8b4665cab7,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:42.182211 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c9234f94-ce52-4c2b-8627-5112bbd80ad7 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e2a96f629edd4f7ea0678a7a5fe690d1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3109448 Nov 24 16:07:42.182739 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34410) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:42.184772 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee9838c-6840-4964-926a-730747b41990 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=007a0158-4449-4445-9fec-76a4d64030b8,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:42.190704 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5ee9838c-6840-4964-926a-730747b41990 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6bec57646f0747b7a914f4c8a4ea25f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3813262 Nov 24 16:07:42.193475 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34412) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:42.251101 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.256004 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.278615 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.293182 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.387023 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.390309 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.395220 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/007a0158-4449-4445-9fec-76a4d64030b8 HTTP/1.1" status: 204 len: 168 time: 0.2006850 Nov 24 16:07:42.407805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.411255 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:42.417631 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/94c2c5cd-6288-4c19-987b-3c8b4665cab7 HTTP/1.1" status: 204 len: 168 time: 0.2290871 Nov 24 16:07:42.417888 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33634b5-475b-4a4d-873f-54c8be425a80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=007a0158-4449-4445-9fec-76a4d64030b8,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:42.454168 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f0e28a-f6a2-4325-a37a-8f7deb7c20de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94c2c5cd-6288-4c19-987b-3c8b4665cab7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:42.544125 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd32f20-0724-40bb-8e74-c42961dbc12e req-7706c610-1dff-48a0-bc2c-3aab9b5e6b05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:42.552405 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fdd32f20-0724-40bb-8e74-c42961dbc12e req-7706c610-1dff-48a0-bc2c-3aab9b5e6b05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1383429 Nov 24 16:07:42.634780 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fdd32f20-0724-40bb-8e74-c42961dbc12e req-7e5ea2d8-e11e-43f6-8b19-ad857d11b1eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806115 Nov 24 16:07:42.921725 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39add02f-885f-48b3-bfa0-24355b0cb7f6 req-d8ad8c03-827f-4b04-aa67-40d046d114b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:42.924025 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-39add02f-885f-48b3-bfa0-24355b0cb7f6 req-d8ad8c03-827f-4b04-aa67-40d046d114b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0957394 Nov 24 16:07:43.008655 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-39add02f-885f-48b3-bfa0-24355b0cb7f6 req-2ffaeb82-fb95-43db-aa45-2acbe06ce473 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774829 Nov 24 16:07:43.143371 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-28a8575a-03bb-484b-8f65-0ec66c01dd52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:43.146365 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-28a8575a-03bb-484b-8f65-0ec66c01dd52 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.1019313 Nov 24 16:07:43.202005 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001e657a-7ffa-429a-b634-530008eaf732 req-b551afaf-e7fb-4f6b-8c84-c0d50e2a36cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:43.205277 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-001e657a-7ffa-429a-b634-530008eaf732 req-b551afaf-e7fb-4f6b-8c84-c0d50e2a36cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1068351 Nov 24 16:07:43.337452 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-b19a8e6d-2abd-402d-a472-24cb2958d477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:43.339490 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-b19a8e6d-2abd-402d-a472-24cb2958d477 service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.1802480 Nov 24 16:07:43.344586 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-001e657a-7ffa-429a-b634-530008eaf732 req-967d8cc4-5bdc-44d6-9e1b-ad47d21bb5a5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736287 Nov 24 16:07:43.395985 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-9aedf66d-0c37-4391-9f49-bda3de0f2777 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.0491867 Nov 24 16:07:43.490465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-059e06cf-213e-4842-9b11-2f6c090e72d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:43.493610 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-059e06cf-213e-4842-9b11-2f6c090e72d5 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.0805998 Nov 24 16:07:43.594348 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-5526e6a2-c9d9-49e7-b44f-50b71c015f8b service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0803566 Nov 24 16:07:43.824182 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-afdaecfa-f653-41f5-bf10-32f8dd30597d service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219560 Nov 24 16:07:43.830371 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:43.898254 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34484) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:44.015566 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-816488fb-3e30-4b45-8b15-c6929b02f5f4 req-849edfdf-7aea-4893-81f8-d439a4c70c1f service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1811390 Nov 24 16:07:44.146968 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1055956853-network', 'tenant_id': '3b09c1b1b2994015967d00aba299005b'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:44.199178 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Made reservation on behalf of 3b09c1b1b2994015967d00aba299005b for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:44.203602 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.220534 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.256984 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 req-16c311b5-bf92-4811-ba03-be5bcee6defd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:44.260072 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 req-16c311b5-bf92-4811-ba03-be5bcee6defd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0786123 Nov 24 16:07:44.349318 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 req-e9e6a904-ea20-4b2e-ae0f-b367baa7f0df tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822766 Nov 24 16:07:44.371708 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.386891 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.409496 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1048} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:07:44.429367 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.430015 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Added segment f8c02baf-f798-42ce-a13d-1280c21c3434 of type vlan for network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 Nov 24 16:07:44.536395 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.600398 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.601349 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:44.602557 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.616597 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48b8a254-8580-4ea5-aa35-4dfce9b414ab,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:44.655776 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34504) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:44.663841 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.7633712 Nov 24 16:07:44.667894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34508) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:44.672830 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Request body: {'subnet': {'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1055956853-subnet', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:44.731640 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Made reservation on behalf of 3b09c1b1b2994015967d00aba299005b for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:44.736288 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:44.899810 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9649d136-7408-41c0-bd4e-65f8a80f27cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.012447 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99af35e-5d8b-4cc8-b02e-5f1e41ffdc7e admin admin] Pushing event updated for resources: {'Network': ['ID=5bfa1501-ec44-4dcf-b786-02db2672e4a7,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:45.029933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:07:45.039550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 req-d8d60490-14e7-4d92-b99a-851db5cbdcf3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:45.043939 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 req-d8d60490-14e7-4d92-b99a-851db5cbdcf3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.5247862 Nov 24 16:07:45.121785 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 req-e9571dfa-3215-47f5-af7c-d57fe7470e93 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652187 Nov 24 16:07:45.157605 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9649d136-7408-41c0-bd4e-65f8a80f27cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.160426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.178797 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9649d136-7408-41c0-bd4e-65f8a80f27cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.337866 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9649d136-7408-41c0-bd4e-65f8a80f27cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3529ffd4-c747-46f6-963b-057820eea81f,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:45.358543 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34522) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:45.360096 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-9649d136-7408-41c0-bd4e-65f8a80f27cf admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=2ab8d27a73ca433e85e7b8b6d219848c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7027624 Nov 24 16:07:45.374489 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Pushing event updated for resources: {'Subnet': ['ID=639f9430-29e6-4689-9e38-afdda9766d8e,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:45.401019 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Checking segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:45.401966 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Network hostable DHCP agents. Network: 5bfa1501-ec44-4dcf-b786-02db2672e4a7, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:07:45.437320 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:07:45.455113 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.457342 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 5bfa1501-ec44-4dcf-b786-02db2672e4a7) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:45.467254 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:45.468767 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.474136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9a72db8-5b22-4423-b524-51d7d86ae4f4 None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:45.505581 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.505828 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-300432e0-36b0-4f61-b38b-ab871767847e admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8348978 Nov 24 16:07:45.511496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34524) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:45.519465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:45.584969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.588333 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.629497 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.636197 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.640141 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/3529ffd4-c747-46f6-963b-057820eea81f HTTP/1.1" status: 204 len: 168 time: 0.2775776 Nov 24 16:07:45.670637 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753f6d0a-329a-4762-9fed-2a82d63ee8db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3529ffd4-c747-46f6-963b-057820eea81f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:45.751851 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.783106 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:07:45.785164 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:45.971779 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.003668 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:07:46.085338 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Allocated IP 172.20.0.2 (5bfa1501-ec44-4dcf-b786-02db2672e4a7/639f9430-29e6-4689-9e38-afdda9766d8e/4080d5b5-d627-42a7-b0e9-25fa22fac195) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:46.332586 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.343761 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.356339 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b40e74-89ea-4848-85ae-c243c54619d9 req-42054235-10f2-4002-91c8-a37d80d20156 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:46.366929 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-38b40e74-89ea-4848-85ae-c243c54619d9 req-42054235-10f2-4002-91c8-a37d80d20156 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0906780 Nov 24 16:07:46.407286 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.418522 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:46.424306 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:46.432022 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:46.454319 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.467690 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Pushing event updated for resources: {'Port': ['ID=4080d5b5-d627-42a7-b0e9-25fa22fac195,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:46.475152 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-38b40e74-89ea-4848-85ae-c243c54619d9 req-7c454e99-439c-4e71-a291-4167e0c234a4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062520 Nov 24 16:07:46.573458 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Attempting to bind port 4080d5b5-d627-42a7-b0e9-25fa22fac195 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:46.574417 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Attempting to bind port 4080d5b5-d627-42a7-b0e9-25fa22fac195 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:46.575115 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Attempting to bind port 4080d5b5-d627-42a7-b0e9-25fa22fac195 on network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:46.589471 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:46.589932 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Checking segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:46.590282 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.592331 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Bound using segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:46.592885 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Bound port: 4080d5b5-d627-42a7-b0e9-25fa22fac195, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:46.593317 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.684448 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] For port 4080d5b5-d627-42a7-b0e9-25fa22fac195, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:46.690805 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] For port 4080d5b5-d627-42a7-b0e9-25fa22fac195, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4080d5b5-d627-42a7-b0e9-25fa22fac195,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:46.691268 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Allocated IP 172.27.0.66 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/14bf6abc-9e62-4e60-9593-4ad5c8c6e399) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:46.699302 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.783329 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339acccb-a111-42d3-a2a6-021c853ee79b None None] Pushing event updated for resources: {'Port': ['ID=4080d5b5-d627-42a7-b0e9-25fa22fac195,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:46.904188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:46.950806 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:47.012650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:47.018276 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:47.022244 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:47.227230 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Pushing event updated for resources: {'Port': ['ID=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:47.446967 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:47.703062 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 req-60f6bea3-283a-4000-bc2c-6ce1c0ab8264 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:47.704650 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 req-60f6bea3-283a-4000-bc2c-6ce1c0ab8264 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0846701 Nov 24 16:07:47.871717 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 req-748cfb0c-0dbe-4bb9-b6fb-cecca89853f7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282291 Nov 24 16:07:47.887887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:48.246251 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0986beb7-88e9-460a-9dba-75461702844c None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:48.293524 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Router 6b4ede60-92bd-4670-939a-9a888194c526 is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:07:48.391364 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] Provisioning complete for port 4080d5b5-d627-42a7-b0e9-25fa22fac195 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:48.391987 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:48.443303 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:07:48.463164 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Sync routers for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:07:48.471190 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:48.477673 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34586) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:48.479099 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-cbe15ed2-9dad-46eb-bd15-a09b5eba40db admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.9653530 Nov 24 16:07:48.484315 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:48.485472 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:48.733080 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:48.736458 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:48.748418 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-69ec9c21-801f-4cc0-bfee-454a50edc539 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:48.946258 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4080d5b5-d627-42a7-b0e9-25fa22fac195 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:49.070187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34604) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:49.083903 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] For port 4080d5b5-d627-42a7-b0e9-25fa22fac195, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4080d5b5-d627-42a7-b0e9-25fa22fac195,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:49.100412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.112036 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 4080d5b5-d627-42a7-b0e9-25fa22fac195 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:49.112642 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.222441 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:47Z', 'revision_number': 3, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:49.250293 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Deleting subnet ed727f6a-2faf-4b68-8b60-0a34df7a9d04 {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:07:49.258726 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.286633 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Checking router: 6b4ede60-92bd-4670-939a-9a888194c526 for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:07:49.287581 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Updating router 6b4ede60-92bd-4670-939a-9a888194c526 port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:07:49.366797 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.379740 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.388109 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b049416e-6a54-425d-8eab-04c083bed0fe None None] Pushing event updated for resources: {'Port': ['ID=4080d5b5-d627-42a7-b0e9-25fa22fac195,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:49.421201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.530136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b3f67292-5a3a-4dc7-a984-95569069251a None None] Provisioning complete for port 4080d5b5-d627-42a7-b0e9-25fa22fac195 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:49.530612 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b3f67292-5a3a-4dc7-a984-95569069251a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.573696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.588835 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.630756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed727f6a-2faf-4b68-8b60-0a34df7a9d04,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:49.634805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.640941 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ad3db9d2-42c8-4f6c-96db-76551d5e5053 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/ed727f6a-2faf-4b68-8b60-0a34df7a9d04 HTTP/1.1" status: 204 len: 168 time: 0.5672605 Nov 24 16:07:49.642379 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34610) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:49.710034 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e89aa6-ef81-423c-92e2-284f5f9c29ad req-f882a895-5675-4c59-a694-14d057690e02 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:49.721947 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-50e89aa6-ef81-423c-92e2-284f5f9c29ad req-f882a895-5675-4c59-a694-14d057690e02 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.2109265 Nov 24 16:07:49.768847 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:49.831206 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-50e89aa6-ef81-423c-92e2-284f5f9c29ad req-4fa86076-4038-42d1-bb40-050062d78fc4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065941 Nov 24 16:07:49.946780 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Allocated IP 172.20.0.1 (5bfa1501-ec44-4dcf-b786-02db2672e4a7/639f9430-29e6-4689-9e38-afdda9766d8e/c7604272-2019-4eb1-b9f5-030ba5c460ea) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:49.968123 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.005724 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.019457 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.021668 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.022139 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.023025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.023930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > port after_create 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.023930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.024999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > port after_update 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.025430 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.025887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.026302 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.026719 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.121308 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.122029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.122594 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.123136 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102788) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:07:50.123727 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4efd686c-40bc-444c-9747-bab40f56f9c5']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:50.135659 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Attempting to bind port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:50.136240 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Attempting to bind port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:50.137020 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Attempting to bind port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:50.140729 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.143862 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Pushing event updated for resources: {'Port': ['ID=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,revision_number=2']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:50.146237 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e389c70b-0393-494e-a5ef-236a61738571') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:50.146658 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e389c70b-0393-494e-a5ef-236a61738571') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:50.161466 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:50.162463 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:50.163356 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.164808 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:50.165941 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Bound port: 14bf6abc-9e62-4e60-9593-4ad5c8c6e399, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:50.166841 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.168741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.174050 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.175500 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.176184 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.176862 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.178473 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.179248 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.181097 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.181842 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.182538 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.183233 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.183990 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.184722 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:07:50.199234 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.210538 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.230669 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Releasing vlan 1001 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:07:50.231404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: from cryptography.utils import int_from_bytes Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: from cryptography.utils import int_from_bytes Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:07:50.249424 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:07:50.287626 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] For port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:50.288014 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:50.293458 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:50.296312 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] For port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:50.296679 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:50.311406 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.320637 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.351154 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Pushing event updated for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:50.373924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Pushing event deleted for resources: {'Network': ['ID=4efd686c-40bc-444c-9747-bab40f56f9c5,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:50.377741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.380082 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.389671 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e7acb53e-a5a0-486f-b213-59974f868147 admin admin] 10.222.0.72 "DELETE /v2.0/networks/4efd686c-40bc-444c-9747-bab40f56f9c5 HTTP/1.1" status: 204 len: 168 time: 0.7459691 Nov 24 16:07:50.391489 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34626) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:50.553606 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:50.554251 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:50.562541 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9989a0-0cd9-4386-ad09-94c9cc276580 None None] Pushing event updated for resources: {'Port': ['ID=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:50.612743 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Deleting subnet 0cc19b1d-2e51-4a54-9914-477c6a864813 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:07:50.622198 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.701304 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4080d5b5-d627-42a7-b0e9-25fa22fac195 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:50.736395 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.751978 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:50.760088 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.803798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-8f9bd8b3-c815-45a4-a329-9f03885528ce None None] Provisioning complete for port c7604272-2019-4eb1-b9f5-030ba5c460ea triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:50.803798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8f9bd8b3-c815-45a4-a329-9f03885528ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.845757 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 4080d5b5-d627-42a7-b0e9-25fa22fac195 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:50.846256 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.875140 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-8f9bd8b3-c815-45a4-a329-9f03885528ce None None] Port c7604272-2019-4eb1-b9f5-030ba5c460ea cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:07:50.888618 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:50.995538 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:47Z', 'revision_number': 3, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:51.033600 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f2ccd5-4ed3-4e97-a0bf-8f540778020f None None] The sync data for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi is: [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:47Z', 'revision_number': 3, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:07:51.100345 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.154362 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0cc19b1d-2e51-4a54-9914-477c6a864813,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:51.159842 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.163276 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-e5746f35-5865-40dc-a252-40f461b2338f admin admin] 10.222.0.72 "DELETE /v2.0/subnets/0cc19b1d-2e51-4a54-9914-477c6a864813 HTTP/1.1" status: 204 len: 168 time: 0.7707100 Nov 24 16:07:51.168016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34634) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:51.222314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.275030 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-423b74fd-2b5d-4e3e-b417-0e660d0fa786 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.298109 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.373893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.406318 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Pushing event updated for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:51.411797 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.576722 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.610535 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f895734-73a2-4f8e-88b4-6eadbfdf2113']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:51.629164 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '69755eb1-d460-42be-9075-148d3e55d06c') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:51.630138 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '69755eb1-d460-42be-9075-148d3e55d06c') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:51.642480 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.655045 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:51.658760 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:51.674203 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.685854 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Releasing vlan 1028 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:07:51.686498 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:07:51.757579 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:07:51.938746 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-6cf3531a-0271-4314-9d3f-3cb7cc1a46b6 None None] Provisioning complete for port c7604272-2019-4eb1-b9f5-030ba5c460ea triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:51.939370 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6cf3531a-0271-4314-9d3f-3cb7cc1a46b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.954186 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.967233 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:51.979021 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] 10.222.0.72 "DELETE /v2.0/networks/7f895734-73a2-4f8e-88b4-6eadbfdf2113 HTTP/1.1" status: 204 len: 168 time: 0.8096313 Nov 24 16:07:52.011981 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ea9d20-5874-4ecf-888b-397357554851 admin admin] Pushing event deleted for resources: {'Network': ['ID=7f895734-73a2-4f8e-88b4-6eadbfdf2113,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:52.025304 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-6cf3531a-0271-4314-9d3f-3cb7cc1a46b6 None None] Port c7604272-2019-4eb1-b9f5-030ba5c460ea cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:07:52.060513 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Router 6b4ede60-92bd-4670-939a-9a888194c526 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:07:52.292896 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34646) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:52.308817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:07:52.314411 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c44f5826-3505-4dfa-b195-2435a66021a3 admin admin] 10.222.0.72 "PUT /v2.0/routers/6b4ede60-92bd-4670-939a-9a888194c526/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8340633 Nov 24 16:07:52.365151 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-57d3b38b-ceb1-42bc-84cf-e5f388ef27ff admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=121ec25020ef44b88c3a39f5f2e6272c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0679147 Nov 24 16:07:52.367974 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34652) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:52.434183 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.471459 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.527741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.531773 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.533732 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/badc6fcb-94eb-4262-8813-13f6031dccc7 HTTP/1.1" status: 204 len: 168 time: 0.1643300 Nov 24 16:07:52.546633 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcaced4-6ee3-47cc-80cf-92519cef589e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=badc6fcb-94eb-4262-8813-13f6031dccc7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:52.620774 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.697260 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:52.778963 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:52.779533 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.912584 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:52.950343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:52.958136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.064702 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:53.265545 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Sync routers for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:07:53.289692 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:53.290797 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:53.325915 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34674) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:53.410216 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34676) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:53.411848 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-91d1339d-06df-4b73-a4fd-ab392351ed86 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=79d1667cdb1746a6b228a8ed8c4b16b3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0841422 Nov 24 16:07:53.522028 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:53.546480 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.612957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.701655 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34682) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:53.712152 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1533739057-network', 'tenant_id': '931febe58cd44954b13dcb5b47841624'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:53.737200 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.743482 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.746081 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/118ef861-7473-438d-908a-08cf907fb561 HTTP/1.1" status: 204 len: 168 time: 0.3329463 Nov 24 16:07:53.767994 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357d63f1-d360-40ba-9147-61f51ba1de75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=118ef861-7473-438d-908a-08cf907fb561,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:53.784728 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Made reservation on behalf of 931febe58cd44954b13dcb5b47841624 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:53.793773 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.836552 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.947477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 2, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:53.982442 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.988094 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:53.997174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Checking router: 6b4ede60-92bd-4670-939a-9a888194c526 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:07:53.998098 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Updating router 6b4ede60-92bd-4670-939a-9a888194c526 port c7604272-2019-4eb1-b9f5-030ba5c460ea binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:07:54.016041 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1011} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:07:54.034066 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0181b05-7f50-4cde-ba30-2e0a12ad539f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:54.040849 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.041856 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.042404 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Added segment b0c82001-5cda-4e61-adb0-5386e8d7fe18 of type vlan for network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 Nov 24 16:07:54.106408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.157845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.159511 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:54.160553 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.223735 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5180869 Nov 24 16:07:54.228143 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34692) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:54.234284 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Request body: {'subnet': {'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1533739057-subnet', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:54.292348 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Made reservation on behalf of 931febe58cd44954b13dcb5b47841624 for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:07:54.294695 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29486263'] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.322261 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c36f7bdd-0499-4e24-a4a7-598e5f139b89 admin admin] Pushing event updated for resources: {'Network': ['ID=6f3d5341-c722-4cef-961d-6f0a15c8ff92,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:54.353899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:07:54.366508 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.607793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.639038 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29518501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29486213'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.687109 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:54.715531 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d1ef0457-5a2b-4ce2-ade0-e40400c004c8,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:54.752232 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Checking segment: {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:54.752747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Network hostable DHCP agents. Network: 6f3d5341-c722-4cef-961d-6f0a15c8ff92, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:07:54.792114 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:07:54.817946 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 6f3d5341-c722-4cef-961d-6f0a15c8ff92) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:54.826783 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.834777 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:07:54.837073 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d24936d5-d189-4288-93c0-3b59dc66520f None None] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:54.837969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.874598 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-924d5bc3-bcab-4678-a185-389c2db44bf0 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6445365 Nov 24 16:07:54.877717 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34712) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:54.880932 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.887775 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:07:54.936678 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:54.940252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.066396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.269798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:55.270818 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.330775 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.346509 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c83ec7-ae53-402d-bf87-59796d838724 None None] Pushing event updated for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:55.581189 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Attempting to bind port c7604272-2019-4eb1-b9f5-030ba5c460ea on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:55.582373 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Attempting to bind port c7604272-2019-4eb1-b9f5-030ba5c460ea by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:55.583352 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Attempting to bind port c7604272-2019-4eb1-b9f5-030ba5c460ea on network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:55.598757 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:55.599288 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Checking segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:55.600035 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.600554 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Bound using segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:55.602282 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Bound port: c7604272-2019-4eb1-b9f5-030ba5c460ea, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:55.602813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.634154 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-444e88aa-ef34-45b8-8857-419c97f719b9 None None] Provisioning complete for port c7604272-2019-4eb1-b9f5-030ba5c460ea triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:55.634940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-444e88aa-ef34-45b8-8857-419c97f719b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.644228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:07:55.645881 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.673406 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.696755 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:55.824697 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-444e88aa-ef34-45b8-8857-419c97f719b9 None None] Port c7604272-2019-4eb1-b9f5-030ba5c460ea cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:07:55.829612 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Allocated IP 172.27.0.30 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/47711002-6eb0-4310-9bbf-38ec3196de91) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:55.935247 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] For port c7604272-2019-4eb1-b9f5-030ba5c460ea, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:55.961722 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] For port c7604272-2019-4eb1-b9f5-030ba5c460ea, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c7604272-2019-4eb1-b9f5-030ba5c460ea,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:55.991201 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.051623 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.065271 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Allocated IP 172.20.0.2 (6f3d5341-c722-4cef-961d-6f0a15c8ff92/d1ef0457-5a2b-4ce2-ade0-e40400c004c8/0738bc1d-57dd-4608-80db-65d4c8cf95b7) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:56.093067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c83ec7-ae53-402d-bf87-59796d838724 None None] Pushing event updated for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:56.098098 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:56.098754 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:56.139200 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.225770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:56.235273 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:56.242206 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:56.330152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:56.458653 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Pushing event updated for resources: {'Port': ['ID=47711002-6eb0-4310-9bbf-38ec3196de91,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:56.595318 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] Provisioning complete for port c7604272-2019-4eb1-b9f5-030ba5c460ea triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:56.595696 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.607752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.644186 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.750910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:56.761095 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:56.763708 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:56.773002 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Pushing event updated for resources: {'Port': ['ID=0738bc1d-57dd-4608-80db-65d4c8cf95b7,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:56.797718 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.881567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.885821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Attempting to bind port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:56.886211 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Attempting to bind port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:56.886650 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Attempting to bind port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 on network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:56.905989 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:56.906382 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Checking segment: {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:56.906767 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.907174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Bound using segment: {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:56.907664 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Bound port: 0738bc1d-57dd-4608-80db-65d4c8cf95b7, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:56.908060 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:56.936084 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:55Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:56.983065 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb4e23a-0275-4bdf-9029-d73f179561d0 None None] The sync data for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi is: [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:55Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:07:57.007384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] For port c7604272-2019-4eb1-b9f5-030ba5c460ea, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c7604272-2019-4eb1-b9f5-030ba5c460ea,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:57.021635 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:57.165417 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] For port 0738bc1d-57dd-4608-80db-65d4c8cf95b7, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:57.191117 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] For port 0738bc1d-57dd-4608-80db-65d4c8cf95b7, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=0738bc1d-57dd-4608-80db-65d4c8cf95b7,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:57.192569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90eb35f0-f6ac-49bf-b7ea-3ecd6746fc08 None None] Pushing event updated for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:57.201473 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:57.202715 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:57.381246 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6971600d-8449-4510-8b17-b0f7334fd3e9 None None] Pushing event updated for resources: {'Port': ['ID=0738bc1d-57dd-4608-80db-65d4c8cf95b7,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:57.533973 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Router c7f99318-c2d6-486a-b218-d9f85c2f211c is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:07:57.747520 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:07:57.780197 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Sync routers for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:07:57.785795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:57.788650 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-8797808f-650b-4171-a104-ba516673dcda admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.9086738 Nov 24 16:07:57.793410 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34772) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:07:57.844330 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:57.845118 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:58.021135 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:58.425478 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 3, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:07:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:58.481472 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Checking router: c7f99318-c2d6-486a-b218-d9f85c2f211c for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:07:58.482576 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Updating router c7f99318-c2d6-486a-b218-d9f85c2f211c port 47711002-6eb0-4310-9bbf-38ec3196de91 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:07:58.516093 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:58.552027 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:58.836348 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 0738bc1d-57dd-4608-80db-65d4c8cf95b7 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:07:58.887984 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34cd3e19-5944-487f-9597-67b2fa035f9a None None] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:07:58.928186 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Allocated IP 172.20.0.1 (6f3d5341-c722-4cef-961d-6f0a15c8ff92/d1ef0457-5a2b-4ce2-ade0-e40400c004c8/e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:07:58.964830 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] Provisioning complete for port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:58.965229 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.084396 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:59.084774 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.093491 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.100737 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.154219 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.224249 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Attempting to bind port 47711002-6eb0-4310-9bbf-38ec3196de91 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:07:59.225050 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Attempting to bind port 47711002-6eb0-4310-9bbf-38ec3196de91 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:07:59.225847 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Attempting to bind port 47711002-6eb0-4310-9bbf-38ec3196de91 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:07:59.227623 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.235368 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:07:59.236056 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:07:59.236642 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.237245 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:07:59.237929 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Bound port: 47711002-6eb0-4310-9bbf-38ec3196de91, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:07:59.238526 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.254811 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:07:59.258853 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:07:59.290306 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:07:59.332845 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b580796-94f3-4933-b4d1-14612e5e078d None None] Pushing event updated for resources: {'Port': ['ID=47711002-6eb0-4310-9bbf-38ec3196de91,revision_number=2']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:59.342596 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] For port 47711002-6eb0-4310-9bbf-38ec3196de91, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:07:59.344170 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Pushing event updated for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:59.350587 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] For port 47711002-6eb0-4310-9bbf-38ec3196de91, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=47711002-6eb0-4310-9bbf-38ec3196de91,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:07:59.358640 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.363980 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.405366 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.502920 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.516220 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b580796-94f3-4933-b4d1-14612e5e078d None None] Pushing event updated for resources: {'Port': ['ID=47711002-6eb0-4310-9bbf-38ec3196de91,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:59.531272 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] For port 0738bc1d-57dd-4608-80db-65d4c8cf95b7, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=0738bc1d-57dd-4608-80db-65d4c8cf95b7,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:07:59.537573 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.548066 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:07:59.549232 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:07:59.599466 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:07:59.649765 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a6d920-c091-49e0-b57b-e124823b1d44 None None] Pushing event updated for resources: {'Port': ['ID=0738bc1d-57dd-4608-80db-65d4c8cf95b7,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:07:59.653879 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.db.api [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102789) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 16:07:59.654248 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG oslo_db.api [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 16:07:59.755162 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:07:59.781314 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2ed7a286-41a4-4d4d-8c6a-73514aa168b4 None None] Provisioning complete for port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:07:59.782093 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2ed7a286-41a4-4d4d-8c6a-73514aa168b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.122821 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f', 'name': '', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'mac_address': 'fa:16:3e:fc:e5:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:58Z', 'updated_at': '2021-11-24T16:07:58Z', 'revision_number': 1, 'project_id': '931febe58cd44954b13dcb5b47841624', 'subnets': [{'id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:08:00.160631 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.168471 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.220973 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c7604272-2019-4eb1-b9f5-030ba5c460ea up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:00.231934 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.280647 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1f7f02-bd3c-4cda-bf45-b4700b61d768 None None] The sync data for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi is: [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f', 'name': '', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'mac_address': 'fa:16:3e:fc:e5:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:58Z', 'updated_at': '2021-11-24T16:07:58Z', 'revision_number': 1, 'project_id': '931febe58cd44954b13dcb5b47841624', 'subnets': [{'id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:08:00.299074 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-c0c3de3f-6558-4a4d-a4d9-b6dac2973dd5 None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:00.299621 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c0c3de3f-6558-4a4d-a4d9-b6dac2973dd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.303011 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Pushing event updated for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:00.411777 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:08:00.413281 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:08:00.440607 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port c7604272-2019-4eb1-b9f5-030ba5c460ea triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:00.441639 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:00.478361 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-c0c3de3f-6558-4a4d-a4d9-b6dac2973dd5 None None] Port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:08:00.533966 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34810) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:00.814127 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Router c7f99318-c2d6-486a-b218-d9f85c2f211c has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:08:00.900877 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 0738bc1d-57dd-4608-80db-65d4c8cf95b7 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:00.959943 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-963a1c5f-c0c3-4431-ba83-8d062bd182f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.003541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:01.004252 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.051250 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:08:01.069064 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-1ac9bfea-13a0-4e6c-a117-1c738a99f16b admin admin] 10.222.0.72 "PUT /v2.0/routers/c7f99318-c2d6-486a-b218-d9f85c2f211c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2632008 Nov 24 16:08:01.079860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-593db332-e422-48ee-8c9b-35dc8ca842ca None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:01.080295 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-593db332-e422-48ee-8c9b-35dc8ca842ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.172241 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-593db332-e422-48ee-8c9b-35dc8ca842ca None None] Port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:08:01.184629 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-963a1c5f-c0c3-4431-ba83-8d062bd182f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.192385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-963a1c5f-c0c3-4431-ba83-8d062bd182f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.245349 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-963a1c5f-c0c3-4431-ba83-8d062bd182f1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=bb30ef9b842845c9a069fa0515cff06c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7097363 Nov 24 16:08:01.246328 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-963a1c5f-c0c3-4431-ba83-8d062bd182f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b010bfce-15c1-48f5-977b-ca913816e25e,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:01.248889 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34818) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:01.315201 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.356948 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.432179 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.438936 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:01.443123 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b010bfce-15c1-48f5-977b-ca913816e25e HTTP/1.1" status: 204 len: 168 time: 0.1899424 Nov 24 16:08:01.454586 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c3cf73-81b6-4ae8-b1c4-6a76358a462e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b010bfce-15c1-48f5-977b-ca913816e25e,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:02.110667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 34852) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:02.137722 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e72ec1f5-264f-4b94-abb2-ae2a81c06ead admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.296383 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e72ec1f5-264f-4b94-abb2-ae2a81c06ead admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.302761 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e72ec1f5-264f-4b94-abb2-ae2a81c06ead admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.438161 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e72ec1f5-264f-4b94-abb2-ae2a81c06ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efbbf169-c897-4e05-90bd-abbcea20ceb2,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:02.493231 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039d16d8-b33f-47b7-aeec-9b1633b59144 req-70cb0f9b-90ce-4040-b4eb-bc0dc02cc0fa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:02.495797 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-039d16d8-b33f-47b7-aeec-9b1633b59144 req-70cb0f9b-90ce-4040-b4eb-bc0dc02cc0fa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1016681 Nov 24 16:08:02.509117 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e72ec1f5-264f-4b94-abb2-ae2a81c06ead admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f21d0c3007db4c149344efef2d8fc3c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3967433 Nov 24 16:08:02.509563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 34872) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:02.541003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-4f61591c-262c-43a3-9cb7-4f87b343d449 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:02.543829 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-4f61591c-262c-43a3-9cb7-4f87b343d449 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.1338868 Nov 24 16:08:02.656053 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.690743 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-039d16d8-b33f-47b7-aeec-9b1633b59144 req-44ca2a83-4e38-48dd-b59f-b67dcaff09ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1686411 Nov 24 16:08:02.715827 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.743264 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-b0026e12-e7fd-4971-9458-0e202481d604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:02.747402 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-b0026e12-e7fd-4971-9458-0e202481d604 service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.1963151 Nov 24 16:08:02.870438 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.873665 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:02.880383 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/efbbf169-c897-4e05-90bd-abbcea20ceb2 HTTP/1.1" status: 204 len: 168 time: 0.3657947 Nov 24 16:08:02.915104 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 47711002-6eb0-4310-9bbf-38ec3196de91 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:02.923952 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-5b3237fa-e257-4cff-b84f-c7793b832131 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.1621215 Nov 24 16:08:02.931493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-421a0d9f-c5f9-4a9d-aa7d-18f359fcd08a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efbbf169-c897-4e05-90bd-abbcea20ceb2,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:03.071519 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 47711002-6eb0-4310-9bbf-38ec3196de91 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:03.075571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-5b212105-a08f-4a55-b26e-9fd41c9ef6aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:03.075986 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:03.078806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-5b212105-a08f-4a55-b26e-9fd41c9ef6aa service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.1350369 Nov 24 16:08:03.174265 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-d099e6c0-c170-47b8-bb58-55627acd1ef7 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0719311 Nov 24 16:08:03.299462 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:03.381854 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 47711002-6eb0-4310-9bbf-38ec3196de91, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=47711002-6eb0-4310-9bbf-38ec3196de91,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:03.400486 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:03.430864 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-6fd5ca65-29de-48ad-af4a-883b67554a31 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:03.432972 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-6fd5ca65-29de-48ad-af4a-883b67554a31 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.5438197 Nov 24 16:08:03.494129 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-e79ea340-fa4f-42da-bc0b-da6829de5bda tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/quotas/20c9176ab8ef44ffb17eda5f41aca2a8 HTTP/1.1" status: 200 len: 375 time: 0.0428572 Nov 24 16:08:03.522673 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-b91e5dd2-e57c-4249-9a74-fbf68d175efa service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2620387 Nov 24 16:08:03.555987 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=47711002-6eb0-4310-9bbf-38ec3196de91,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:03.982118 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818c879f-461b-4416-94ce-5885e8382499 req-e9d6c0dd-5c85-4884-8751-751abf034084 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:03.985816 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-d30b1be9-b9b9-4ced-8453-b7bebcf8ce1c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4856591 Nov 24 16:08:04.009546 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-818c879f-461b-4416-94ce-5885e8382499 req-e9d6c0dd-5c85-4884-8751-751abf034084 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1883321 Nov 24 16:08:04.100251 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-818c879f-461b-4416-94ce-5885e8382499 req-7c98c10e-20e4-4fda-a384-4e202a4d3a5f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872710 Nov 24 16:08:04.137471 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ccbe286f-2aa7-41c2-b091-2004edd2f20d req-8cc83f51-a217-436c-b309-23daf83991cf service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2834611 Nov 24 16:08:04.263323 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-55b92244-faca-4951-9107-2f47c4f25b17 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2758589 Nov 24 16:08:04.482112 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-4c8e93df-5361-4447-838a-a68742d51a91 service neutron] 10.222.0.72 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2167916 Nov 24 16:08:04.771040 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-81216190-a1cb-46bf-a7c5-38c6d74a9cd5 req-de1c7322-2e01-4d91-9d1f-2596914d31fa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 210 time: 0.0843377 Nov 24 16:08:04.910395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Sync routers for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:08:04.936941 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 47711002-6eb0-4310-9bbf-38ec3196de91 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:04.974475 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:08:04.976277 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:08:05.246792 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:08:05.419636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 47711002-6eb0-4310-9bbf-38ec3196de91 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:05.420027 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:05.614240 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60bf46ed-1335-4d7e-be51-f97dcd99be71 req-2a3935e3-804b-4c63-8199-0263fe1a4504 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:05.620001 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-60bf46ed-1335-4d7e-be51-f97dcd99be71 req-2a3935e3-804b-4c63-8199-0263fe1a4504 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1814733 Nov 24 16:08:05.830580 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-60bf46ed-1335-4d7e-be51-f97dcd99be71 req-b24c1176-d27f-4ca4-9bc4-454d1660f44f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1861782 Nov 24 16:08:06.190601 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc4b1086-4911-472b-83db-29d95cd08840 req-83298a96-12d3-42fa-aa95-50d21ceb66d2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 210 time: 0.1052456 Nov 24 16:08:06.226330 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f', 'name': '', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'mac_address': 'fa:16:3e:fc:e5:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:58Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 2, 'project_id': '931febe58cd44954b13dcb5b47841624', 'subnets': [{'id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:08:06.264898 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Checking router: c7f99318-c2d6-486a-b218-d9f85c2f211c for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:08:06.265619 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Updating router c7f99318-c2d6-486a-b218-d9f85c2f211c port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:08:06.300050 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:06.879770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-45a7d695-9d5e-48b1-a691-dc519e2b1b8d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:06.883896 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-45a7d695-9d5e-48b1-a691-dc519e2b1b8d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 815 time: 0.2585430 Nov 24 16:08:06.916673 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Request body: {'port': {'device_id': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'admin_state_up': True, 'tenant_id': '20c9176ab8ef44ffb17eda5f41aca2a8'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:08:06.931546 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:06.952296 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.165433 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Made reservation on behalf of 20c9176ab8ef44ffb17eda5f41aca2a8 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:08:07.176325 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.227175 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08731043-6efb-4e3d-a03b-404ef28afd2d None None] Pushing event updated for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:07.228789 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f req-2dafb25f-ad9b-4a38-b005-cfeec6e4ceaa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:07.237739 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Attempting to bind port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:08:07.238331 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Attempting to bind port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:08:07.238925 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Attempting to bind port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f on network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:08:07.247850 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f req-2dafb25f-ad9b-4a38-b005-cfeec6e4ceaa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.2185061 Nov 24 16:08:07.255027 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:08:07.255767 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Checking segment: {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:08:07.257334 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.258699 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Bound using segment: {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:08:07.259599 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Bound port: e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b0c82001-5cda-4e61-adb0-5386e8d7fe18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1011, 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:08:07.260296 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.398127 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f req-0ecba456-ddb9-442e-8d81-0eb647a2d409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071537 Nov 24 16:08:07.486531 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Allocated IP 172.20.0.7 (fafb4435-765d-4616-9638-8248f7ef836b/d3e375f9-d96e-4117-a4ce-55baac3893ba/a960049b-51b1-4158-8da6-316ecd0c7259) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:08:07.557878 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 req-7d4f4dec-fc20-4f19-9668-5a4ae866bfde tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 210 time: 0.0408504 Nov 24 16:08:07.599635 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] For port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:08:07.607469 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] For port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:08:07.614504 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.700415 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08731043-6efb-4e3d-a03b-404ef28afd2d None None] Pushing event updated for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:07.738265 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:08:07.739874 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:07:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:08:07.803434 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.892611 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:07.954642 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Network fafb4435-765d-4616-9638-8248f7ef836b is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:08:07.959688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:08:07.964661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:08:07.992674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event updated for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:08.061015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:08.062239 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.087190 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-c6f7087c-bc57-4d79-b1e4-cafd91eff5e4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1792927 Nov 24 16:08:08.089492 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:08.089960 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.101935 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Request body: {'port': {'device_id': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:08:08.130402 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e', '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'f6b62b55-c282-46ef-a9ba-700f74a8fa81'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:08:08.212201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.226997 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:08:08.417775 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.554272 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] For port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:08.683371 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3eb56e0-3430-4302-b641-9be676879ca2 req-320bfaa7-2362-4641-bb83-7bbd58ed043a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:08.687339 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a3eb56e0-3430-4302-b641-9be676879ca2 req-320bfaa7-2362-4641-bb83-7bbd58ed043a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1129568 Nov 24 16:08:08.728737 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.798489 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a3eb56e0-3430-4302-b641-9be676879ca2 req-bef5a530-76cb-4eec-a7f1-95d6678b4e79 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026990 Nov 24 16:08:08.859241 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a960049b-51b1-4158-8da6-316ecd0c7259 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:08:08.883563 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:08.904148 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa req-ce8856aa-96ea-4bce-a39c-394e2cc8fe58 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:08.911582 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa req-ce8856aa-96ea-4bce-a39c-394e2cc8fe58 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 931 time: 0.2269423 Nov 24 16:08:08.936041 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:08.938509 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Transition to ACTIVE for port object a960049b-51b1-4158-8da6-316ecd0c7259 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:08:08.955865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.011926 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-5dafcd00-793b-405d-bb52-aa09900c3521 None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:09.012288 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5dafcd00-793b-405d-bb52-aa09900c3521 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.032951 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c24fd63-a2f4-42fa-a801-08fe3e091803 None None] Pushing event updated for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:09.159421 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f', 'name': '', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'mac_address': 'fa:16:3e:fc:e5:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:58Z', 'updated_at': '2021-11-24T16:08:07Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'subnets': [{'id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:08:09.165876 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa req-3e0b16c4-9614-4389-b825-b838d8d2ea1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2533209 Nov 24 16:08:09.169387 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Pushing event updated for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:09.215024 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Attempting to bind port a960049b-51b1-4158-8da6-316ecd0c7259 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:08:09.215498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Attempting to bind port a960049b-51b1-4158-8da6-316ecd0c7259 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:08:09.215782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Attempting to bind port a960049b-51b1-4158-8da6-316ecd0c7259 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:08:09.216626 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4429eb-8921-494e-9755-d13e5e877c62 None None] The sync data for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi is: [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:07:59Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f', 'name': '', 'network_id': '6f3d5341-c722-4cef-961d-6f0a15c8ff92', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'mac_address': 'fa:16:3e:fc:e5:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:58Z', 'updated_at': '2021-11-24T16:08:07Z', 'revision_number': 4, 'project_id': '931febe58cd44954b13dcb5b47841624', 'subnets': [{'id': 'd1ef0457-5a2b-4ce2-ade0-e40400c004c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:08:09.230674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Port a960049b-51b1-4158-8da6-316ecd0c7259 on network fafb4435-765d-4616-9638-8248f7ef836b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:08:09.236178 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Attempting to bind port a960049b-51b1-4158-8da6-316ecd0c7259 on network fafb4435-765d-4616-9638-8248f7ef836b {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:08:09.253569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:09.253950 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.254444 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 7, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:08:09.254898 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Checking segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:08:09.258096 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Bound using segment: {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:08:09.264640 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Bound port: a960049b-51b1-4158-8da6-316ecd0c7259, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '02833ec3-3410-4203-939b-a89b1f0c3745', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1015, 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:08:09.265195 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.393357 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:08:09.399148 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a960049b-51b1-4158-8da6-316ecd0c7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:08:09.406635 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.490566 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:09.491753 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:09.508800 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] 10.222.0.71 "PUT /v2.0/ports/a960049b-51b1-4158-8da6-316ecd0c7259 HTTP/1.1" status: 200 len: 1093 time: 1.3978200 Nov 24 16:08:09.509350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:09.515420 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51df429b-a3bb-4fdd-b24f-504c8861dcb5" -d '{"events": [{"name": "network-changed", "server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:09.607884 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 x-openstack-request-id: req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:09.608281 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:09.608557 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:09.608983 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259', 'status': 'completed', 'code': 200} Nov 24 16:08:09.641752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83d6c26-0610-45cc-b5b9-addee4b48ba3 service neutron] Pushing event updated for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:09.686226 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-11724ca2-b4a5-4a8a-95cd-5a0c1ab8ab80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:09.688089 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-11724ca2-b4a5-4a8a-95cd-5a0c1ab8ab80 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 1096 time: 0.1169302 Nov 24 16:08:09.777677 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-f94e5eef-c594-4621-915c-27a09cb1e9e7 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a960049b-51b1-4158-8da6-316ecd0c7259 HTTP/1.1" status: 200 len: 217 time: 0.0805717 Nov 24 16:08:09.846715 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b162a44-8d24-491d-a440-fb331994614b req-428326b7-f863-4f76-9a45-06be1893e22c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:09.848402 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-428326b7-f863-4f76-9a45-06be1893e22c service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0554121 Nov 24 16:08:09.889705 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-2323d064-47a9-45c5-8872-f066de4d4c55 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0320594 Nov 24 16:08:09.903429 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35022) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:10.014575 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 req-89a8ab10-aab0-4a9b-8f7a-0240b6481219 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:10.024117 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 req-89a8ab10-aab0-4a9b-8f7a-0240b6481219 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0879588 Nov 24 16:08:10.043889 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-6869acc6-88e7-48f2-8f70-353cd220092a service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1290998 Nov 24 16:08:10.091944 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5edd6f3c-be0e-43ba-b74b-8144006ff822 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.157196 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 req-473cb41d-485a-4afe-b84b-9569648ad259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299374 Nov 24 16:08:10.193941 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b162a44-8d24-491d-a440-fb331994614b req-41db0c89-e805-4b0f-94f9-0fb2c1d3d215 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1391501 Nov 24 16:08:10.295618 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5edd6f3c-be0e-43ba-b74b-8144006ff822 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.301083 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5edd6f3c-be0e-43ba-b74b-8144006ff822 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.379179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-cebfa3d6-8ba7-4516-bc87-0c2747e80522 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:10.385934 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-cebfa3d6-8ba7-4516-bc87-0c2747e80522 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 1096 time: 0.0952418 Nov 24 16:08:10.428131 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5edd6f3c-be0e-43ba-b74b-8144006ff822 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c680976b0ad744d7b089a59180213400&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5233624 Nov 24 16:08:10.431696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35032) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:10.435865 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edd6f3c-be0e-43ba-b74b-8144006ff822 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c994e03-53ed-4a69-8a82-5eb148219180,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:10.468188 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce18b81e-89ed-4557-8160-8322be659d95 req-a0fe23d6-2030-4746-8e67-346172088bc1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:10.469795 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ce18b81e-89ed-4557-8160-8322be659d95 req-a0fe23d6-2030-4746-8e67-346172088bc1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 943 time: 0.1539180 Nov 24 16:08:10.541295 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ce18b81e-89ed-4557-8160-8322be659d95 req-62eff544-18e1-42c6-946a-a5d4a9fce03a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629501 Nov 24 16:08:10.573310 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-8f8f47cb-7239-4912-a090-8527f00de121 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:10.574806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-8f8f47cb-7239-4912-a090-8527f00de121 service neutron] 10.222.0.71 "GET /v2.0/networks?id=fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 200 len: 917 time: 0.1804926 Nov 24 16:08:10.575615 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.633143 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-163be230-2e9f-4dc8-980a-d31dcaeb19c0 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a960049b-51b1-4158-8da6-316ecd0c7259 HTTP/1.1" status: 200 len: 217 time: 0.0470345 Nov 24 16:08:10.638520 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.715316 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-86995143-ef9b-4a94-86d8-b57c2b5a5604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:10.717284 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-86995143-ef9b-4a94-86d8-b57c2b5a5604 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 200 len: 855 time: 0.0765986 Nov 24 16:08:10.761222 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-4cda030e-8500-4530-9b8d-43b2b80b55cf service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=fafb4435-765d-4616-9638-8248f7ef836b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0362031 Nov 24 16:08:10.813388 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.816014 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.819911 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/2c994e03-53ed-4a69-8a82-5eb148219180 HTTP/1.1" status: 204 len: 168 time: 0.3867960 Nov 24 16:08:10.821167 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:10.837364 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb81563-ce8a-412e-a81f-39907a9980d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c994e03-53ed-4a69-8a82-5eb148219180,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:10.963194 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:10.963828 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:10.974683 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0071f0a8-5597-4fa5-95c5-9e37a56f8de9 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2036364 Nov 24 16:08:11.226109 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-27a0346c-ae8e-499b-b3bf-cd661bedbc20 service neutron] 10.222.0.71 "GET /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2318485 Nov 24 16:08:11.411687 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a33752b-f29c-43bd-98f0-40a7204444a1 req-da9f960f-a957-4066-ac43-51c26580eb2e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:11.415703 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4a33752b-f29c-43bd-98f0-40a7204444a1 req-da9f960f-a957-4066-ac43-51c26580eb2e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0863700 Nov 24 16:08:11.507261 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4a33752b-f29c-43bd-98f0-40a7204444a1 req-2d954117-4062-41a4-a285-9e05cb857339 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782259 Nov 24 16:08:11.754141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fff2f1d-6523-4549-bf73-30934b383328 req-b85397da-250f-4de1-8fb2-01174451387f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:11.757506 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8fff2f1d-6523-4549-bf73-30934b383328 req-b85397da-250f-4de1-8fb2-01174451387f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 943 time: 0.0950012 Nov 24 16:08:11.841405 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8fff2f1d-6523-4549-bf73-30934b383328 req-40905ff3-4a81-43f0-9a65-08714248fa22 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700471 Nov 24 16:08:12.737770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62aa5eb2-ea0b-426e-b7f8-145a0f6a7cb4 req-507845b9-0df1-45e1-a81e-3ef245a42fcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:12.740402 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-62aa5eb2-ea0b-426e-b7f8-145a0f6a7cb4 req-507845b9-0df1-45e1-a81e-3ef245a42fcc service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.1831577 Nov 24 16:08:12.841056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89707fe-bea2-4635-a49b-cb73f4bcff60 req-6d652d3d-3e16-4314-bd66-9f887ca1d61e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:12.842620 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f89707fe-bea2-4635-a49b-cb73f4bcff60 req-6d652d3d-3e16-4314-bd66-9f887ca1d61e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1300147 Nov 24 16:08:12.884904 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-62aa5eb2-ea0b-426e-b7f8-145a0f6a7cb4 req-d4381bdb-7238-4c72-80fd-868a19a5f872 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134734 Nov 24 16:08:12.922219 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f89707fe-bea2-4635-a49b-cb73f4bcff60 req-c66f6e62-96b8-4bcc-8ddf-784ffb33036f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645640 Nov 24 16:08:12.978829 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f req-0e5e44a0-e019-40ce-966e-57a2f1a7a957 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:12.981280 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f req-0e5e44a0-e019-40ce-966e-57a2f1a7a957 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 943 time: 0.0683751 Nov 24 16:08:13.045584 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f req-a58e052a-5ce1-45f4-9b42-4a29d6a62004 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582986 Nov 24 16:08:13.419927 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a960049b-51b1-4158-8da6-316ecd0c7259 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:08:13.579248 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a960049b-51b1-4158-8da6-316ecd0c7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:13.594159 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'a960049b-51b1-4158-8da6-316ecd0c7259', 'network_id': 'fafb4435-765d-4616-9638-8248f7ef836b', 'port_id': 'a960049b-51b1-4158-8da6-316ecd0c7259', 'mac_address': 'fa:16:3e:56:22:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1015, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3e375f9-d96e-4117-a4ce-55baac3893ba', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:08:13.649945 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:13.670609 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a960049b-51b1-4158-8da6-316ecd0c7259 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:08:13.697065 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a960049b-51b1-4158-8da6-316ecd0c7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:13.707863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:13.779799 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:13.829021 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:14.155643 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511bf9ed-1a2d-4f19-a715-a059346a0483 req-d071e457-e3fe-4aac-b248-00132f110e29 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:14.162616 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-511bf9ed-1a2d-4f19-a715-a059346a0483 req-d071e457-e3fe-4aac-b248-00132f110e29 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0956161 Nov 24 16:08:14.229625 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7ece8d-0385-47cb-89b8-627a82870d56 req-cc275e77-384c-4eb7-b992-43b49e6d29fd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:14.231327 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6e7ece8d-0385-47cb-89b8-627a82870d56 req-cc275e77-384c-4eb7-b992-43b49e6d29fd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 944 time: 0.0780182 Nov 24 16:08:14.261537 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-511bf9ed-1a2d-4f19-a715-a059346a0483 req-db3a69c4-1725-4247-9eca-0b5df777e822 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848997 Nov 24 16:08:14.279386 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['a960049b-51b1-4158-8da6-316ecd0c7259'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:08:14.319629 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6e7ece8d-0385-47cb-89b8-627a82870d56 req-7572c682-736c-47ce-b1d2-2f429b96c35f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779035 Nov 24 16:08:15.460570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35114) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:15.491711 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d01817-f0ce-4256-a0e3-4cadcbafd154 req-d97c8528-7676-4e5d-9352-2eafc534f022 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:15.500140 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-97d01817-f0ce-4256-a0e3-4cadcbafd154 req-d97c8528-7676-4e5d-9352-2eafc534f022 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0833511 Nov 24 16:08:15.510577 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a887fa80-6cb0-4a74-9657-71eff8a63c86 req-9db1e26b-6f75-4813-9d5c-d06c8262da82 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:15.513184 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a887fa80-6cb0-4a74-9657-71eff8a63c86 req-9db1e26b-6f75-4813-9d5c-d06c8262da82 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 944 time: 0.1013753 Nov 24 16:08:15.597527 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-97d01817-f0ce-4256-a0e3-4cadcbafd154 req-7e71c3c8-657a-45ee-91f4-80c850c05025 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955343 Nov 24 16:08:15.659706 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a887fa80-6cb0-4a74-9657-71eff8a63c86 req-04e1f04f-4534-4f67-a469-7cfb9f22d7f5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1383004 Nov 24 16:08:15.772433 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-100234d6-7235-4bdd-a33e-a333a422f29f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:15.885417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-100234d6-7235-4bdd-a33e-a333a422f29f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:15.890532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-100234d6-7235-4bdd-a33e-a333a422f29f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:15.933003 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-100234d6-7235-4bdd-a33e-a333a422f29f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=7cf27d956da448e880b1cfea6f6ea4d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4696329 Nov 24 16:08:15.936795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35126) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:08:15.939060 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100234d6-7235-4bdd-a33e-a333a422f29f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c5578ef-ab73-48d8-9410-c4edb2c1e17b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:16.003674 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:16.032007 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:16.090610 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:16.093844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:16.095178 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9c5578ef-ab73-48d8-9410-c4edb2c1e17b HTTP/1.1" status: 204 len: 168 time: 0.1570964 Nov 24 16:08:16.106169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e68e06f-ecac-4929-b1a0-1884c5d10d0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c5578ef-ab73-48d8-9410-c4edb2c1e17b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:16.245253 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-961a0efc-43a5-4e8d-ba20-fec8dd827c76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:16.248628 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-961a0efc-43a5-4e8d-ba20-fec8dd827c76 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=60b309e35e734edbaf96c844838de867&device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 1098 time: 0.0630324 Nov 24 16:08:16.280678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a6a26b-552a-420f-a8a4-62c94ed654e9 req-000b57ed-fce1-4433-8238-510c937379de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:16.286624 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-96a6a26b-552a-420f-a8a4-62c94ed654e9 req-000b57ed-fce1-4433-8238-510c937379de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0729773 Nov 24 16:08:16.349575 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-96a6a26b-552a-420f-a8a4-62c94ed654e9 req-5a3a1f10-e013-4c71-a0c4-7833121f1e40 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529449 Nov 24 16:08:16.382929 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-97cdb9c4-f12b-43b6-a73d-8a202aeb1fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:16.384340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-97cdb9c4-f12b-43b6-a73d-8a202aeb1fd0 service neutron] 10.222.0.71 "GET /v2.0/networks?id=df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 200 len: 921 time: 0.1301684 Nov 24 16:08:16.441538 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-128f4e05-2a5d-4e2a-8016-92cbbc33fe39 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 200 len: 217 time: 0.0482576 Nov 24 16:08:16.496870 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-c4a89587-6df5-45e6-8469-5c6b7a100391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:16.501541 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-c4a89587-6df5-45e6-8469-5c6b7a100391 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 200 len: 859 time: 0.0526180 Nov 24 16:08:16.535333 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-913e4149-bbd2-484b-9712-cc911df54b02 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=df42b516-6753-481b-a21c-74d7dd325e73&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265493 Nov 24 16:08:16.653203 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-1e101825-27e9-457d-9401-3ad19be75e19 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1098070 Nov 24 16:08:16.788426 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9848d38-9551-41fa-ba8b-7fd342937b10 req-acf6022a-5047-40f6-8370-c9ecc10bb4dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:16.796187 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c9848d38-9551-41fa-ba8b-7fd342937b10 req-acf6022a-5047-40f6-8370-c9ecc10bb4dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 944 time: 0.0666878 Nov 24 16:08:16.867439 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c9848d38-9551-41fa-ba8b-7fd342937b10 req-eaad3d0c-6061-4677-bebc-9d7a4f0bc7ef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672126 Nov 24 16:08:17.005150 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-79e47536-3388-4f9c-86ba-017ba6739680 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3142867 Nov 24 16:08:17.077260 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d27d125c-d668-4055-bab0-6d44ee7d26b7 req-34338d06-c4f4-45df-8b43-e0a6a578f3a7 service neutron] 10.222.0.71 "GET /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4162855 Nov 24 16:08:17.091887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-65f536b3-6ffe-4400-a335-babed0c256f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.093407 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-65f536b3-6ffe-4400-a335-babed0c256f8 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1098 time: 0.0656004 Nov 24 16:08:17.216613 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-4c34af11-632c-481b-9c3d-a7a38a814ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.218232 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-4c34af11-632c-481b-9c3d-a7a38a814ef4 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.1015408 Nov 24 16:08:17.290405 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-a5b4170b-029c-4851-b7f0-05e8e5560f88 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 1001 time: 0.0631487 Nov 24 16:08:17.355913 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-587e2750-1d10-46ac-ba9d-a9c8f76de275 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.357652 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-587e2750-1d10-46ac-ba9d-a9c8f76de275 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0578744 Nov 24 16:08:17.438399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-89b56f07-7e56-4fe1-b54d-f69d8d802a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.441602 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-89b56f07-7e56-4fe1-b54d-f69d8d802a29 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0735466 Nov 24 16:08:17.442106 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a960049b-51b1-4158-8da6-316ecd0c7259 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:17.511640 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port a960049b-51b1-4158-8da6-316ecd0c7259 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:08:17.522480 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port a960049b-51b1-4158-8da6-316ecd0c7259 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:17.523069 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:17.616728 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-e5eeb4ee-e223-4652-9cab-b94ea922ff66 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.618350 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-e5eeb4ee-e223-4652-9cab-b94ea922ff66 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 815 time: 0.1702094 Nov 24 16:08:17.627275 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 req-f6fd250d-6c61-4e80-882f-2fd7da135772 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.628994 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 req-f6fd250d-6c61-4e80-882f-2fd7da135772 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1359956 Nov 24 16:08:17.644553 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-b8050aea-19f1-4f4f-a6f1-c03392f24991 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/quotas/3b09c1b1b2994015967d00aba299005b HTTP/1.1" status: 200 len: 375 time: 0.0175543 Nov 24 16:08:17.655886 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:17.660335 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-2efbcde9-4d11-43ea-b005-d435f2f2d8e6 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2016480 Nov 24 16:08:17.680867 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:17.683314 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51419e5e-f37c-40e0-b446-b0313f117f8f" -d '{"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-plugged", "status": "completed", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:17.696664 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a960049b-51b1-4158-8da6-316ecd0c7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:17.701481 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:17.705651 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-7bbcd69e-671d-4f3a-90e6-a32c5c841893 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0513842 Nov 24 16:08:17.724890 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 req-ab373c58-90e6-4420-b359-b062d54f1644 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0874500 Nov 24 16:08:17.764887 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:17.791637 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53c8c374-d06f-4bc2-8135-42fcad6ed6da x-openstack-request-id: req-53c8c374-d06f-4bc2-8135-42fcad6ed6da {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:17.791961 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-plugged", "status": "completed", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:17.792231 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-53c8c374-d06f-4bc2-8135-42fcad6ed6da {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:17.792622 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259', 'code': 200} Nov 24 16:08:17.793503 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6e61e248-55f9-435c-9b31-8d90abadb34d req-0578fa83-0eeb-4569-b82e-6b2f542bb117 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254582 Nov 24 16:08:17.830330 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-1a8750bd-e93f-44eb-babd-7ce9f93b5e02 service neutron] 10.222.0.72 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1116719 Nov 24 16:08:17.929682 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-313a7d12-2efb-4472-bc75-df88e9a21051 service neutron] 10.222.0.72 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930848 Nov 24 16:08:17.994329 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 req-f9ebdab6-0dfe-4754-bc76-4e5e7f104495 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:17.995907 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 req-f9ebdab6-0dfe-4754-bc76-4e5e7f104495 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0608902 Nov 24 16:08:18.074743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f65a698-2207-4a97-b79d-2057b21c5778 req-149772dd-0d6e-49d2-a633-7a27de38a50e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:18.076285 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3f65a698-2207-4a97-b79d-2057b21c5778 req-149772dd-0d6e-49d2-a633-7a27de38a50e service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 1098 time: 0.0794752 Nov 24 16:08:18.079745 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 req-61757dcd-bc80-45dc-aee9-5279c13f0e75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739617 Nov 24 16:08:18.137240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3f65a698-2207-4a97-b79d-2057b21c5778 req-e3aa83cc-5156-476e-8077-94926ddcf5f7 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528898 Nov 24 16:08:18.173741 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0f5a3a79-49c8-4cb5-8951-2b89ae659230 req-033618ac-f9e1-465f-b43b-ef8d013b5987 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 210 time: 0.0353956 Nov 24 16:08:18.608944 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8d274540-a4aa-4a92-80f0-35f584208966 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:18.852825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abb0b51-7707-4738-bd5a-6892ff3ef46f req-ddd9d474-ef35-421f-a143-09c4ca86bd94 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:18.854365 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4abb0b51-7707-4738-bd5a-6892ff3ef46f req-ddd9d474-ef35-421f-a143-09c4ca86bd94 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0554044 Nov 24 16:08:18.902240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4abb0b51-7707-4738-bd5a-6892ff3ef46f req-7f276f25-679a-4148-87a9-f278d9da7d99 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420051 Nov 24 16:08:19.240727 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c69179e-d826-4b20-9be3-cb23d65f8315 req-83bd1a63-975f-4b14-97ee-c35cf6777275 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:19.242540 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c69179e-d826-4b20-9be3-cb23d65f8315 req-83bd1a63-975f-4b14-97ee-c35cf6777275 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0694542 Nov 24 16:08:19.290501 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-0e02f29c-fa86-499f-bb0c-d7a1921f71a0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:19.291956 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-0e02f29c-fa86-499f-bb0c-d7a1921f71a0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 815 time: 0.1320183 Nov 24 16:08:19.309909 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'port': {'device_id': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'admin_state_up': True, 'tenant_id': '3b09c1b1b2994015967d00aba299005b'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:08:19.316579 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c69179e-d826-4b20-9be3-cb23d65f8315 req-92f83031-9ac8-4a71-817e-d196f0abdd9d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615611 Nov 24 16:08:19.375185 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c75c309d-0bfc-4508-88f4-99726448235a req-af113217-2dd6-421c-8865-73a9feb2cb69 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 210 time: 0.0588799 Nov 24 16:08:19.465761 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Made reservation on behalf of 3b09c1b1b2994015967d00aba299005b for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:08:19.469770 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:19.618310 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Allocated IP 172.20.0.13 (5bfa1501-ec44-4dcf-b786-02db2672e4a7/639f9430-29e6-4689-9e38-afdda9766d8e/fe858985-c82e-488e-aceb-25ed4bffc8ee) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:08:19.786171 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:19.829880 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:19.891030 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:08:19.895588 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:08:19.902591 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:08:19.963243 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:19.964120 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:19.974422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:20.007695 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-280d9da1-48ea-4b14-bf8b-de3213fd4ac9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7052791 Nov 24 16:08:20.104007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8def3e6a-68f4-446b-81e7-e27f883e034b req-244472db-c840-4332-a6f7-f81c63dbda2d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:20.117466 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8def3e6a-68f4-446b-81e7-e27f883e034b req-244472db-c840-4332-a6f7-f81c63dbda2d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0886874 Nov 24 16:08:20.199760 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-f63966fe-258e-4660-918e-b4c9fa9d96c8 None None] Provisioning complete for port fe858985-c82e-488e-aceb-25ed4bffc8ee triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:20.200248 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f63966fe-258e-4660-918e-b4c9fa9d96c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:20.213107 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8def3e6a-68f4-446b-81e7-e27f883e034b req-47d923d8-6885-4974-8159-032eed5f6e9d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912833 Nov 24 16:08:20.263959 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-f63966fe-258e-4660-918e-b4c9fa9d96c8 None None] Port fe858985-c82e-488e-aceb-25ed4bffc8ee cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:08:20.453738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea432f88-b737-460e-b417-f631917b9e17 req-bd22d319-8cc7-4052-966c-ce5464e439e1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:20.455233 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ea432f88-b737-460e-b417-f631917b9e17 req-bd22d319-8cc7-4052-966c-ce5464e439e1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0562725 Nov 24 16:08:20.503776 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ea432f88-b737-460e-b417-f631917b9e17 req-47d60a7b-7b36-4b56-8cda-c061051ba898 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421040 Nov 24 16:08:20.624182 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c0c5aa-116c-43f5-a0e3-811b548ad838 req-8d9df47d-76be-4d12-b2c0-c78c20622abc tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:20.626248 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-40c0c5aa-116c-43f5-a0e3-811b548ad838 req-8d9df47d-76be-4d12-b2c0-c78c20622abc tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 932 time: 0.0507023 Nov 24 16:08:20.673269 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-40c0c5aa-116c-43f5-a0e3-811b548ad838 req-1cb08e43-a643-42d5-8521-f65b18470c40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394292 Nov 24 16:08:21.250029 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-30fa1981-2b3b-4c6e-81f3-733150b8f898 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:22.621964 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:23.003281 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:08:24.310956 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:24.445189 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:38.330754 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Request body: {'port': {'device_id': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:08:38.393194 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:38.583432 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e req-9a6fc7f3-9401-46b6-938d-4f21d3624d5c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:38.585208 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e req-9a6fc7f3-9401-46b6-938d-4f21d3624d5c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0552468 Nov 24 16:08:38.642189 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e req-242f4b85-06b4-4d9e-918c-5001a604ddac tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505419 Nov 24 16:08:38.691598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e849562-00cb-4d56-9a93-878b31207f17 req-051ebe06-1024-4d90-8397-d67a7b1a4295 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:38.693945 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8e849562-00cb-4d56-9a93-878b31207f17 req-051ebe06-1024-4d90-8397-d67a7b1a4295 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1974316 Nov 24 16:08:38.741570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fe858985-c82e-488e-aceb-25ed4bffc8ee {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:08:38.756931 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:38.780228 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 req-ea0bd685-41d8-4dc8-9f76-4c6282d76ba3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:38.781311 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Transition to ACTIVE for port object fe858985-c82e-488e-aceb-25ed4bffc8ee will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:08:38.781996 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 req-ea0bd685-41d8-4dc8-9f76-4c6282d76ba3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 932 time: 0.0637197 Nov 24 16:08:38.796845 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:38.839132 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8e849562-00cb-4d56-9a93-878b31207f17 req-8c397966-dc41-4a1d-9611-4369e6e63ac3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1142058 Nov 24 16:08:38.849665 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 req-21d55edd-3662-46ad-8b7f-11587c85d586 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542495 Nov 24 16:08:38.869264 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:38.890415 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.891199 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.891778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.892366 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.893112 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.893709 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.894397 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.894972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.895518 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.896657 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.897570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:38.898136 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:39.013638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Attempting to bind port fe858985-c82e-488e-aceb-25ed4bffc8ee on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:08:39.013974 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Attempting to bind port fe858985-c82e-488e-aceb-25ed4bffc8ee by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:08:39.014302 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Attempting to bind port fe858985-c82e-488e-aceb-25ed4bffc8ee on network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:08:39.020221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Port fe858985-c82e-488e-aceb-25ed4bffc8ee on network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:08:39.020561 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Attempting to bind port fe858985-c82e-488e-aceb-25ed4bffc8ee on network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:08:39.028327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 8, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:08:39.028665 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Checking segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:08:39.029152 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Bound using segment: {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:08:39.029599 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Bound port: fe858985-c82e-488e-aceb-25ed4bffc8ee, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f8c02baf-f798-42ce-a13d-1280c21c3434', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:08:39.029960 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:39.121342 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:08:39.126323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:08:39.134369 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:39.184519 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.185171 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:39.186584 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] 10.222.0.71 "PUT /v2.0/ports/fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 1094 time: 0.8603630 Nov 24 16:08:39.187039 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:39.189338 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8664155-8fdb-4d30-a3ee-864b3b8a149f" -d '{"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:39.235889 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b318efe5-9b6e-4730-b179-e710548c524f x-openstack-request-id: req-b318efe5-9b6e-4730-b179-e710548c524f {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:39.236187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:39.236448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-b318efe5-9b6e-4730-b179-e710548c524f {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:39.236858 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:08:39.244213 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ed23a6-fc99-4fe7-a836-2cd8e5fde79a service neutron] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:39.374550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-369c16bd-93ae-4a5a-ac14-dc616659484a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.374550 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-369c16bd-93ae-4a5a-ac14-dc616659484a service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1097 time: 0.0651147 Nov 24 16:08:39.513422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-dd3bfa66-a203-4e33-a73d-4cd10784f391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.514911 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-dd3bfa66-a203-4e33-a73d-4cd10784f391 service neutron] 10.222.0.71 "GET /v2.0/networks?tenant_id=3b09c1b1b2994015967d00aba299005b&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1269152 Nov 24 16:08:39.631002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-0593a783-2bd4-4258-95df-00f165cf3cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.632486 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-0593a783-2bd4-4258-95df-00f165cf3cb6 service neutron] 10.222.0.71 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1050043 Nov 24 16:08:39.751580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-d45e164a-8251-4766-98c0-ae8a72c5b5c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.753145 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-d45e164a-8251-4766-98c0-ae8a72c5b5c1 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1097 time: 0.0577545 Nov 24 16:08:39.783292 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 req-98ba9d14-4144-444e-8736-de9c937d9253 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.784900 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 req-98ba9d14-4144-444e-8736-de9c937d9253 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0603971 Nov 24 16:08:39.805859 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-bae1a868-119c-4845-880b-dc3590774636 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 217 time: 0.0362163 Nov 24 16:08:39.841355 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 req-f8cb183f-d431-482a-8ceb-a477dd838e61 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495462 Nov 24 16:08:39.874853 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-bd56e900-ed2f-4465-a686-1828ef6f2596 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.876840 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-bd56e900-ed2f-4465-a686-1828ef6f2596 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0508528 Nov 24 16:08:39.979867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-ce0e41a9-444b-4460-bb6d-e25a76874703 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:39.981581 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-ce0e41a9-444b-4460-bb6d-e25a76874703 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0914183 Nov 24 16:08:40.012576 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc8a621-344e-4889-ba1d-9d94f454aa31 req-198b41d8-feaf-4346-afbd-74dce4e99c09 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:40.014466 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1bc8a621-344e-4889-ba1d-9d94f454aa31 req-198b41d8-feaf-4346-afbd-74dce4e99c09 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 944 time: 0.0616026 Nov 24 16:08:40.031928 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb43037-f170-4931-887b-cf955c16c6d3 req-2bdf842b-2ce5-4f03-8733-ed3a46b6c71f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:40.035056 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7eb43037-f170-4931-887b-cf955c16c6d3 req-2bdf842b-2ce5-4f03-8733-ed3a46b6c71f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.1052799 Nov 24 16:08:40.101674 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1bc8a621-344e-4889-ba1d-9d94f454aa31 req-f6fb037d-0ff0-489a-87e8-905509827cf5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734782 Nov 24 16:08:40.152070 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7eb43037-f170-4931-887b-cf955c16c6d3 req-463e62cd-a7a9-458e-82b7-10d4759995f7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028020 Nov 24 16:08:40.205174 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-6815cb95-2e2b-4208-a9f6-3d0792f2fde9 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2098722 Nov 24 16:08:40.339175 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 req-7313d4f2-80ef-448b-beb5-6675b2510e13 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244075 Nov 24 16:08:41.222725 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80d11f3-f78a-4184-ae8f-ac0acc180711 req-ccb40019-1304-406f-bcb5-89557d8d534a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:41.224494 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b80d11f3-f78a-4184-ae8f-ac0acc180711 req-ccb40019-1304-406f-bcb5-89557d8d534a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 944 time: 0.0567160 Nov 24 16:08:41.292293 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b80d11f3-f78a-4184-ae8f-ac0acc180711 req-8f6cd020-f12e-41e5-aa2f-4ee02c578262 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593407 Nov 24 16:08:42.450779 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2826e16d-a502-4e26-9c6b-535488f2ef62 req-91e2b57a-3235-4e61-82cf-8b889973cfb4 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:42.452386 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2826e16d-a502-4e26-9c6b-535488f2ef62 req-91e2b57a-3235-4e61-82cf-8b889973cfb4 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 944 time: 0.0710280 Nov 24 16:08:42.509074 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2826e16d-a502-4e26-9c6b-535488f2ef62 req-5537b517-51fd-46c4-acdf-c0fcba7a18f9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505474 Nov 24 16:08:43.684546 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4532076-d370-4d1a-bdea-8b726fdda125 req-b71fcdbe-73aa-468d-9963-90d05826446d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:43.686232 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f4532076-d370-4d1a-bdea-8b726fdda125 req-b71fcdbe-73aa-468d-9963-90d05826446d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 944 time: 0.0637054 Nov 24 16:08:43.742737 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f4532076-d370-4d1a-bdea-8b726fdda125 req-5f736fb6-913f-4fce-88d9-fd0bfbb4fed2 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502529 Nov 24 16:08:43.801178 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:44.873363 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069066ed-8f7e-44b5-9536-2f4c235ffeae req-804c5f86-127b-419c-888f-58e54c7f733d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:44.874991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-069066ed-8f7e-44b5-9536-2f4c235ffeae req-804c5f86-127b-419c-888f-58e54c7f733d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 944 time: 0.0504560 Nov 24 16:08:44.941340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-069066ed-8f7e-44b5-9536-2f4c235ffeae req-2bdb9031-a62b-47cc-bfa2-5ff08354e2cc tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532591 Nov 24 16:08:45.388589 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a req-f236e5a9-e5d0-47f8-8e61-a59f0028cdbe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:45.390207 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a req-f236e5a9-e5d0-47f8-8e61-a59f0028cdbe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0576785 Nov 24 16:08:45.447105 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a req-0ce05be2-9819-4c90-b97e-fe50ca2fb0ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494220 Nov 24 16:08:45.644530 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device fe858985-c82e-488e-aceb-25ed4bffc8ee details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:08:45.757538 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:45.774010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'port_id': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'mac_address': 'fa:16:3e:2d:23:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1048, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:08:45.938643 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:45.962468 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fe858985-c82e-488e-aceb-25ed4bffc8ee {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:08:45.997793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:46.003818 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:46.064559 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:46.073461 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.073815 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.074176 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.074516 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.074857 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.075193 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.075527 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.075857 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.076217 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.076551 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.076878 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.077232 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:08:46.101339 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d862b087-0f45-452f-8fb7-1e0332b07a4d req-b9cc1444-cde4-48c8-bb98-c6d4f38936fe tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:46.102946 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d862b087-0f45-452f-8fb7-1e0332b07a4d req-b9cc1444-cde4-48c8-bb98-c6d4f38936fe tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 945 time: 0.0588682 Nov 24 16:08:46.157185 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d862b087-0f45-452f-8fb7-1e0332b07a4d req-31484fd9-e06d-4f23-9473-a0f8da5ae127 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468335 Nov 24 16:08:46.615674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c695a16-14ac-4822-8f76-ff930f311ea9 req-b824ae05-22d9-4a76-a66e-22ce345501ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:46.617307 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4c695a16-14ac-4822-8f76-ff930f311ea9 req-b824ae05-22d9-4a76-a66e-22ce345501ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0610049 Nov 24 16:08:46.678242 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4c695a16-14ac-4822-8f76-ff930f311ea9 req-72d9dace-c5b2-4744-a79c-5ae402881335 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497539 Nov 24 16:08:46.726987 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:08:47.293530 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256b920a-14a7-423d-a50c-dc0c303c56b0 req-1594cf6d-92bd-4de5-9027-0bb6350ae09e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:47.294969 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-256b920a-14a7-423d-a50c-dc0c303c56b0 req-1594cf6d-92bd-4de5-9027-0bb6350ae09e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 945 time: 0.0567989 Nov 24 16:08:47.347114 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-256b920a-14a7-423d-a50c-dc0c303c56b0 req-83707990-5760-4c1b-9fe5-9b3514b80a98 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461113 Nov 24 16:08:47.816967 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceba94de-d2f4-494a-bd8e-902a2ee69191 req-5582c20f-75be-4e9c-ba7d-aa028cda083f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:47.819110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ceba94de-d2f4-494a-bd8e-902a2ee69191 req-5582c20f-75be-4e9c-ba7d-aa028cda083f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0560813 Nov 24 16:08:47.877059 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ceba94de-d2f4-494a-bd8e-902a2ee69191 req-c5eca4f9-cfe1-4705-ac11-dd4735d3fdcd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513439 Nov 24 16:08:48.486806 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 req-e5165e10-7beb-4d1a-9180-c3027cc23a0f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:48.489171 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 req-e5165e10-7beb-4d1a-9180-c3027cc23a0f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 945 time: 0.0688024 Nov 24 16:08:48.558828 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 req-9fb9e5cc-6ae4-4763-87ae-7c111e090bdd tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589874 Nov 24 16:08:48.608302 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-09fe4f1b-f490-45ed-ba34-595e9297c45f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:49.008107 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 req-6afed5c5-c9b7-4bfa-ac67-ab727b6c8ec2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:49.009711 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 req-6afed5c5-c9b7-4bfa-ac67-ab727b6c8ec2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0526383 Nov 24 16:08:49.075600 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 req-bfde661a-7d32-4e2e-9e05-9c1b39ae1e9f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595083 Nov 24 16:08:49.667372 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device fe858985-c82e-488e-aceb-25ed4bffc8ee up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:08:49.696986 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d req-879d8346-9eb3-4bff-a5e9-13d5302efc5e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:49.698598 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d req-879d8346-9eb3-4bff-a5e9-13d5302efc5e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 945 time: 0.0614128 Nov 24 16:08:49.756486 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d req-1e4f9f24-bf44-442f-af6e-12d9af350ea6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510476 Nov 24 16:08:49.761972 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port fe858985-c82e-488e-aceb-25ed4bffc8ee completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:08:49.766214 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port fe858985-c82e-488e-aceb-25ed4bffc8ee triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:08:49.766587 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:49.843916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1488326-16d6-47bc-a366-cde846640a63 req-e758f0ae-6f87-4cdc-bc92-cfa58dade688 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:49.845491 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d1488326-16d6-47bc-a366-cde846640a63 req-e758f0ae-6f87-4cdc-bc92-cfa58dade688 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0512369 Nov 24 16:08:49.860756 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:49.886273 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:49.888675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b97202ea-861c-43de-9711-2c7ba7db229c" -d '{"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-plugged", "status": "completed", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:49.905937 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:49.911257 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:49.948000 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7785a14-7cf8-48f1-a48d-811aaa9034de x-openstack-request-id: req-b7785a14-7cf8-48f1-a48d-811aaa9034de {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:49.948306 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-plugged", "status": "completed", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:49.948594 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-b7785a14-7cf8-48f1-a48d-811aaa9034de {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:49.948967 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'code': 200} Nov 24 16:08:49.962809 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Deleting port a424f220-1812-4f50-ab01-68a1923ec96d {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:08:49.963163 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:49.978101 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:50.070317 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] For port a424f220-1812-4f50-ab01-68a1923ec96d, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a424f220-1812-4f50-ab01-68a1923ec96d,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:50.070957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:50.088028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling delete_port for a424f220-1812-4f50-ab01-68a1923ec96d owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:08:50.238181 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcbe850d-ae18-427f-b900-8589b55e2a24 req-b772ad55-8be7-4847-8c2a-692bb83cee01 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:50.251479 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dcbe850d-ae18-427f-b900-8589b55e2a24 req-b772ad55-8be7-4847-8c2a-692bb83cee01 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 945 time: 0.0856764 Nov 24 16:08:50.291852 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:50.296602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c8b0ee-02db-423a-adcf-860067950cac req-95876573-3a24-4464-9feb-6e17eee74db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:50.302731 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26c8b0ee-02db-423a-adcf-860067950cac req-95876573-3a24-4464-9feb-6e17eee74db1 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1099 time: 0.1265788 Nov 24 16:08:50.314629 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dcbe850d-ae18-427f-b900-8589b55e2a24 req-57df54f7-b43c-494f-9209-85f2bb545ba8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619557 Nov 24 16:08:50.316152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['533d257a-8aad-4722-8f01-84015f80cdd5', 'a424f220-1812-4f50-ab01-68a1923ec96d'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:08:50.376971 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Pushing event deleted for resources: {'Port': ['ID=a424f220-1812-4f50-ab01-68a1923ec96d,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:50.426923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] No DVR routers for this DVR port a424f220-1812-4f50-ab01-68a1923ec96d on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:08:50.436901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:50.440279 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d1488326-16d6-47bc-a366-cde846640a63 req-5dbd9550-6777-4372-975a-fabb03b85441 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "DELETE /v2.0/ports/a424f220-1812-4f50-ab01-68a1923ec96d HTTP/1.1" status: 204 len: 173 time: 0.5829511 Nov 24 16:08:50.440749 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'name': 'network-vif-deleted', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:50.451059 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a" -d '{"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-deleted", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:50.468185 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26c8b0ee-02db-423a-adcf-860067950cac req-d69d79b6-dd6e-4053-943d-e70948ab0c91 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1461055 Nov 24 16:08:50.562193 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c863d04-c76d-45c2-8d06-ba5d221e767f x-openstack-request-id: req-0c863d04-c76d-45c2-8d06-ba5d221e767f {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:50.562684 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-deleted", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:50.563117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-0c863d04-c76d-45c2-8d06-ba5d221e767f {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:50.563523 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32f50ef3-7864-4548-8230-12ddb5ef83a0', 'name': 'network-vif-deleted', 'tag': 'a424f220-1812-4f50-ab01-68a1923ec96d', 'status': 'completed', 'code': 200} Nov 24 16:08:50.938802 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 req-79c56e06-9f4f-40c7-8ec4-445d425edfb6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:50.940348 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 req-79c56e06-9f4f-40c7-8ec4-445d425edfb6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0747316 Nov 24 16:08:51.010157 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 req-ea78b65c-8bba-4ee6-9d2c-935f15ddb529 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608776 Nov 24 16:08:51.254514 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ee39ee57-d6d2-4757-9701-e628b2a3d3a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:51.436367 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 req-8e96bfc7-e34f-4bc2-8d28-9a530894570e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=32f50ef3-7864-4548-8230-12ddb5ef83a0 HTTP/1.1" status: 200 len: 210 time: 0.0278502 Nov 24 16:08:52.146230 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8baa009-5de8-4e46-bf33-ee750424792b req-d11cc927-e9b6-4211-ae5b-a72d05f9a34d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:52.147877 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b8baa009-5de8-4e46-bf33-ee750424792b req-d11cc927-e9b6-4211-ae5b-a72d05f9a34d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0568168 Nov 24 16:08:52.203057 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b8baa009-5de8-4e46-bf33-ee750424792b req-1718cf34-96e2-44bf-8c11-53bd01c92131 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489674 Nov 24 16:08:52.622281 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:52.782425 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd req-24b4c5ba-ae4c-4b55-b0d0-c1d9a1ac46bd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:52.784239 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd req-24b4c5ba-ae4c-4b55-b0d0-c1d9a1ac46bd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0529957 Nov 24 16:08:52.838797 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd req-dcc18fcf-67f8-49a9-b1e2-96a2105ae528 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460010 Nov 24 16:08:53.335203 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d613b9-2585-4a6c-a676-f977de3b426f req-6bb9ea4a-7b4e-4da0-b45b-4ef98c5ca7bc tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:53.336672 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79d613b9-2585-4a6c-a676-f977de3b426f req-6bb9ea4a-7b4e-4da0-b45b-4ef98c5ca7bc tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0528708 Nov 24 16:08:53.386022 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79d613b9-2585-4a6c-a676-f977de3b426f req-40440120-9e6f-42fb-9ea8-7331db4b441c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433087 Nov 24 16:08:53.527098 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 req-d4d45517-9698-402d-b8de-cea48f38a958 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:53.530157 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 req-d4d45517-9698-402d-b8de-cea48f38a958 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0721369 Nov 24 16:08:53.586615 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 req-403e7fe4-4319-4a5e-ad42-4349e345486b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471132 Nov 24 16:08:53.693581 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a424f220-1812-4f50-ab01-68a1923ec96d no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:08:53.707089 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce142965-bb5d-4e4c-98ba-6cf8d561039b req-7b63e64f-3b5a-4831-ad11-977baaea43d0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:53.709549 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ce142965-bb5d-4e4c-98ba-6cf8d561039b req-7b63e64f-3b5a-4831-ad11-977baaea43d0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0562875 Nov 24 16:08:53.714779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: a424f220-1812-4f50-ab01-68a1923ec96d {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:08:53.715353 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a424f220-1812-4f50-ab01-68a1923ec96d not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:08:53.766630 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ce142965-bb5d-4e4c-98ba-6cf8d561039b req-5b00f34b-aa56-4891-a675-45a83d16b352 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510697 Nov 24 16:08:53.979460 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e66328-100c-46af-beac-43e0e9561634 req-1c2cfae3-8063-450b-8bfc-38b27906eed3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:53.981505 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d4e66328-100c-46af-beac-43e0e9561634 req-1c2cfae3-8063-450b-8bfc-38b27906eed3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0640309 Nov 24 16:08:53.988299 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055a1e73-6bfe-47a6-ae88-1e4810325a6f req-52f63337-ef85-4819-8aa2-7c88f088180d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:53.990976 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-055a1e73-6bfe-47a6-ae88-1e4810325a6f req-52f63337-ef85-4819-8aa2-7c88f088180d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0618598 Nov 24 16:08:54.038547 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d4e66328-100c-46af-beac-43e0e9561634 req-d59fa505-782e-4f29-aeee-7c4c86953d91 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457270 Nov 24 16:08:54.042816 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-055a1e73-6bfe-47a6-ae88-1e4810325a6f req-594c92a1-bd82-4fa1-a777-6551cfa9f2e8 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451906 Nov 24 16:08:54.331921 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:54.358878 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26c8ca6-d454-4766-a1d1-63592855f116 req-9da99b3a-a043-4aba-ad1d-e7d3a429d0de tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:54.368548 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d26c8ca6-d454-4766-a1d1-63592855f116 req-9da99b3a-a043-4aba-ad1d-e7d3a429d0de tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0738349 Nov 24 16:08:54.425845 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d26c8ca6-d454-4766-a1d1-63592855f116 req-21f098ef-deb1-4ec2-9363-353b4ff93551 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575213 Nov 24 16:08:54.458974 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:54.897840 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32256fac-2e89-4c46-8414-2e93776b1c44 req-672d89b8-2776-49e9-aeae-54c20e95e753 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:54.899380 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-32256fac-2e89-4c46-8414-2e93776b1c44 req-672d89b8-2776-49e9-aeae-54c20e95e753 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0552990 Nov 24 16:08:54.952409 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-32256fac-2e89-4c46-8414-2e93776b1c44 req-6daf0715-50c6-4635-90e2-91e11be55b97 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454671 Nov 24 16:08:55.167330 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aff22b7-97d0-44d8-814d-244445796fb5 req-2e284baa-f46f-4930-a081-062ea97d8ca9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:55.168889 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7aff22b7-97d0-44d8-814d-244445796fb5 req-2e284baa-f46f-4930-a081-062ea97d8ca9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0539198 Nov 24 16:08:55.229610 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7aff22b7-97d0-44d8-814d-244445796fb5 req-7f695229-324f-4c29-a30b-25b149d49996 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545743 Nov 24 16:08:55.544600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1429f241-bf40-4090-bf60-0d7b49666375 req-a0b6df04-c378-49c3-aad9-0957c46c9453 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:55.546043 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1429f241-bf40-4090-bf60-0d7b49666375 req-a0b6df04-c378-49c3-aad9-0957c46c9453 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0510859 Nov 24 16:08:55.596241 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1429f241-bf40-4090-bf60-0d7b49666375 req-56e50aae-49de-47aa-bed8-aa1f17a60d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436490 Nov 24 16:08:56.079401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f56220-11ff-4eec-a6bf-0074f1e0c090 req-211e1b0b-208d-499f-8584-8c706b724e3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:56.081103 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-30f56220-11ff-4eec-a6bf-0074f1e0c090 req-211e1b0b-208d-499f-8584-8c706b724e3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0507753 Nov 24 16:08:56.136288 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-30f56220-11ff-4eec-a6bf-0074f1e0c090 req-a7bd064d-0872-49bc-bbd5-ada4fc13ba80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483313 Nov 24 16:08:56.371981 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5522af-f39e-4da8-9589-1073bb9306ad req-c0390f4a-8f09-4b1b-8f77-22b3cd8414fc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:56.373471 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f5522af-f39e-4da8-9589-1073bb9306ad req-c0390f4a-8f09-4b1b-8f77-22b3cd8414fc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0533583 Nov 24 16:08:56.426132 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f5522af-f39e-4da8-9589-1073bb9306ad req-c7e40fc9-9473-408b-a113-5cd5eccc6155 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450947 Nov 24 16:08:56.736567 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73f5477-915b-49c6-bbdc-ac765883b10e req-ea609009-86f7-4c2d-8497-2871e0eb9ae4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:56.738172 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a73f5477-915b-49c6-bbdc-ac765883b10e req-ea609009-86f7-4c2d-8497-2871e0eb9ae4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0563555 Nov 24 16:08:56.793364 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a73f5477-915b-49c6-bbdc-ac765883b10e req-2ab6196d-c286-4557-b3ce-eab48f42918a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462489 Nov 24 16:08:57.084404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-72ca1b9e-8544-4ab9-8cd1-f86835031936 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:57.085995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-72ca1b9e-8544-4ab9-8cd1-f86835031936 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0634043 Nov 24 16:08:57.284068 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Deleting port a960049b-51b1-4158-8da6-316ecd0c7259 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:08:57.284402 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:57.385190 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 req-7c8a2f70-385b-4fd9-b576-d69366564a84 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:57.386991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 req-7c8a2f70-385b-4fd9-b576-d69366564a84 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1424417 Nov 24 16:08:57.613795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4129a44-5aa0-4007-b86d-e45676696e10 req-bb467cd3-c394-481d-890a-36bca30faee7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:57.617498 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b4129a44-5aa0-4007-b86d-e45676696e10 req-bb467cd3-c394-481d-890a-36bca30faee7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0740552 Nov 24 16:08:57.699345 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b4129a44-5aa0-4007-b86d-e45676696e10 req-4140b7e0-3093-412e-ab35-d2b96c7839d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674639 Nov 24 16:08:57.727553 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] For port a960049b-51b1-4158-8da6-316ecd0c7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=a960049b-51b1-4158-8da6-316ecd0c7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:08:57.727879 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:57.760352 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling delete_port for a960049b-51b1-4158-8da6-316ecd0c7259 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:08:57.775595 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 req-9369f109-265f-4af2-92ee-3cf28dc9ef01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3806553 Nov 24 16:08:57.939774 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 req-bff849b7-b087-48ca-9aa4-f9e5e0fafa66 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:57.944976 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 req-bff849b7-b087-48ca-9aa4-f9e5e0fafa66 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=67b8eee7-879b-4194-b4ff-e8bc9c576fd1 HTTP/1.1" status: 200 len: 945 time: 0.0637467 Nov 24 16:08:57.969966 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:58.005010 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event deleted for resources: {'Port': ['ID=a960049b-51b1-4158-8da6-316ecd0c7259,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:08:58.015569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e', '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'a960049b-51b1-4158-8da6-316ecd0c7259'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:08:58.031338 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 req-b8210e6e-440e-4ef6-99b0-428af0bdcde1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760095 Nov 24 16:08:58.058345 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] No DVR routers for this DVR port a960049b-51b1-4158-8da6-316ecd0c7259 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:08:58.062204 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:08:58.066046 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 req-71d3816d-8ec2-4965-9888-faca287879c5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "DELETE /v2.0/ports/a960049b-51b1-4158-8da6-316ecd0c7259 HTTP/1.1" status: 204 len: 173 time: 0.9660692 Nov 24 16:08:58.066540 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'name': 'network-vif-deleted', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:08:58.069542 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b17a149d-22fc-4ef7-bdfe-1664221104e9" -d '{"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-deleted", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:08:58.132233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:08:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd2ccc4b-b646-45dd-ab03-199d2034024d x-openstack-request-id: req-cd2ccc4b-b646-45dd-ab03-199d2034024d {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:08:58.133052 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-deleted", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:08:58.133488 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-cd2ccc4b-b646-45dd-ab03-199d2034024d {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:08:58.134173 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67b8eee7-879b-4194-b4ff-e8bc9c576fd1', 'name': 'network-vif-deleted', 'tag': 'a960049b-51b1-4158-8da6-316ecd0c7259', 'status': 'completed', 'code': 200} Nov 24 16:08:58.873220 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85276b69-542e-48d7-9e55-2fc56db4a64f req-385e85fd-a02d-4e90-b77e-e7790bc27c5a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:58.885078 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-85276b69-542e-48d7-9e55-2fc56db4a64f req-385e85fd-a02d-4e90-b77e-e7790bc27c5a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0787494 Nov 24 16:08:58.944889 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-85276b69-542e-48d7-9e55-2fc56db4a64f req-142f19f1-d884-4fd1-a2a7-62530e376074 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617301 Nov 24 16:08:58.964063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-344ed253-1eac-4a2b-a710-8445e8db976b req-1e439564-eb6c-4749-a7d0-7b1779c5db00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:08:58.966256 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-344ed253-1eac-4a2b-a710-8445e8db976b req-1e439564-eb6c-4749-a7d0-7b1779c5db00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0623593 Nov 24 16:08:59.060744 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-344ed253-1eac-4a2b-a710-8445e8db976b req-cd6c094c-d81d-46cb-9aa6-b36d15271f5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0829146 Nov 24 16:09:00.002727 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:09:00.092283 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ae1d44-c81f-482d-85ec-daf60a499194 req-c452cae1-eb10-47c1-83f0-a2ae6a36c18b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:00.093806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d5ae1d44-c81f-482d-85ec-daf60a499194 req-c452cae1-eb10-47c1-83f0-a2ae6a36c18b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0597162 Nov 24 16:09:00.153751 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d5ae1d44-c81f-482d-85ec-daf60a499194 req-d518432a-2bc1-4120-8460-74f0c08ced5c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530181 Nov 24 16:09:00.224891 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c90433-f440-45cd-a7e0-b13329e5c107 req-82dae549-7fb0-4e42-b3af-27a2c53fca37 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:00.226506 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-06c90433-f440-45cd-a7e0-b13329e5c107 req-82dae549-7fb0-4e42-b3af-27a2c53fca37 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0579774 Nov 24 16:09:00.280506 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-06c90433-f440-45cd-a7e0-b13329e5c107 req-0c6bdfa9-9f2a-4f71-bd05-c2e7398f1539 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479939 Nov 24 16:09:00.671856 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a req-a9a9d812-5745-42f9-940a-0c807fc48f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:00.674507 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a req-a9a9d812-5745-42f9-940a-0c807fc48f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0837109 Nov 24 16:09:00.732985 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a req-a304e8b9-5a53-4cb7-8e18-95e7b51d2f5d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517311 Nov 24 16:09:01.035852 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befddac2-e570-48af-8291-1a07f1f89a87 req-d16f1d2d-0c0f-42c1-a9c0-eb6a91ee6568 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:01.037565 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-befddac2-e570-48af-8291-1a07f1f89a87 req-d16f1d2d-0c0f-42c1-a9c0-eb6a91ee6568 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0712276 Nov 24 16:09:01.159326 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Deleting port 533d257a-8aad-4722-8f01-84015f80cdd5 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:01.160007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:01.295868 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] For port 533d257a-8aad-4722-8f01-84015f80cdd5, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=533d257a-8aad-4722-8f01-84015f80cdd5,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:01.296113 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:01.318222 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling delete_port for 533d257a-8aad-4722-8f01-84015f80cdd5 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:01.344218 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1acf75-fab4-4649-9176-6d29965a30d7 req-a2ef243f-1b6f-422c-a5e3-eccded09ef3a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:01.345858 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ff1acf75-fab4-4649-9176-6d29965a30d7 req-a2ef243f-1b6f-422c-a5e3-eccded09ef3a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/ports?device_id=a3a9b563-1f54-4c61-923f-9b557a3c307b HTTP/1.1" status: 200 len: 945 time: 0.0864079 Nov 24 16:09:01.461653 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ff1acf75-fab4-4649-9176-6d29965a30d7 req-2f9cc8e4-dab8-4227-b363-34bf315edcfa tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /v2.0/security-groups?id=4b97e978-496d-4df2-91d4-02aa61537c15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836864 Nov 24 16:09:01.470892 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a424f27f-5fe8-418f-bc4a-4db826724a14 req-b6ec836b-f3af-491e-b603-9a2c7f1f794a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:01.482298 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a424f27f-5fe8-418f-bc4a-4db826724a14 req-b6ec836b-f3af-491e-b603-9a2c7f1f794a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1118014 Nov 24 16:09:01.536317 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:01.546366 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a424f27f-5fe8-418f-bc4a-4db826724a14 req-bb824205-130a-4f81-ac0b-dcfd49734e11 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509934 Nov 24 16:09:01.564000 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['533d257a-8aad-4722-8f01-84015f80cdd5'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:01.581081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Pushing event deleted for resources: {'Port': ['ID=533d257a-8aad-4722-8f01-84015f80cdd5,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:01.622740 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] No DVR routers for this DVR port 533d257a-8aad-4722-8f01-84015f80cdd5 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:09:01.625326 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:01.631375 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-befddac2-e570-48af-8291-1a07f1f89a87 req-4308ed2d-1122-4a09-abaa-b2ba1e8fd02e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.71 "DELETE /v2.0/ports/533d257a-8aad-4722-8f01-84015f80cdd5 HTTP/1.1" status: 204 len: 173 time: 0.5788493 Nov 24 16:09:01.631375 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'name': 'network-vif-deleted', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:01.632325 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a707240-263a-4425-b25d-5cc4517a951d" -d '{"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-deleted", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:01.671741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8805b77-4e2a-4d60-bd51-175c88d7f48f x-openstack-request-id: req-b8805b77-4e2a-4d60-bd51-175c88d7f48f {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:01.672112 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-deleted", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:01.672463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-b8805b77-4e2a-4d60-bd51-175c88d7f48f {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:01.672880 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3a9b563-1f54-4c61-923f-9b557a3c307b', 'name': 'network-vif-deleted', 'tag': '533d257a-8aad-4722-8f01-84015f80cdd5', 'status': 'completed', 'code': 200} Nov 24 16:09:01.759822 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a960049b-51b1-4158-8da6-316ecd0c7259 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:01.786648 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: a960049b-51b1-4158-8da6-316ecd0c7259 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:01.786996 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device a960049b-51b1-4158-8da6-316ecd0c7259 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:01.867014 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e26044e-aa58-4c88-9702-e675ff0279ea req-76c71a04-3280-4925-a4bc-ef36275ddf19 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:01.868465 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2e26044e-aa58-4c88-9702-e675ff0279ea req-76c71a04-3280-4925-a4bc-ef36275ddf19 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0574784 Nov 24 16:09:01.931655 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2e26044e-aa58-4c88-9702-e675ff0279ea req-30a018f9-80b4-4e7e-92d9-1d93adae974c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569317 Nov 24 16:09:02.530354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35816) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:02.787448 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1626711-2f9e-48b8-a522-175c83a27be2 req-0e9b80f0-1e20-4259-9ed2-875882d68cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:02.789163 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d1626711-2f9e-48b8-a522-175c83a27be2 req-0e9b80f0-1e20-4259-9ed2-875882d68cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1303029 Nov 24 16:09:02.880746 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d1626711-2f9e-48b8-a522-175c83a27be2 req-e6253362-3d40-4541-b59e-7230c857d6cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0854421 Nov 24 16:09:03.078902 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 req-5edcdc36-4b04-466a-9fa9-3d6db7e563d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:03.080340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 req-5edcdc36-4b04-466a-9fa9-3d6db7e563d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0629041 Nov 24 16:09:03.100536 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:03.138237 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 req-03d05e61-e5b2-48c1-99f5-87e1840e973c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498719 Nov 24 16:09:03.647600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Deleting port dc2bf933-b2d7-4297-b8f9-05a72735f52c {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:03.648745 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:03.689113 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-92539f4e-1a0e-4721-8a95-be96f467e386 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:03.690946 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-92539f4e-1a0e-4721-8a95-be96f467e386 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 945 time: 0.0850580 Nov 24 16:09:03.784581 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] For port dc2bf933-b2d7-4297-b8f9-05a72735f52c, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc2bf933-b2d7-4297-b8f9-05a72735f52c,segment=NetworkSegment(331e4e5c-9bcb-4bdc-b3e6-31289c608ef3),segment_id=331e4e5c-9bcb-4bdc-b3e6-31289c608ef3)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:03.784931 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:03.796442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Deleting port f6b62b55-c282-46ef-a9ba-700f74a8fa81 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:03.796996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:03.799584 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Calling delete_port for dc2bf933-b2d7-4297-b8f9-05a72735f52c owned by network:router_interface {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:03.923579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] For port f6b62b55-c282-46ef-a9ba-700f74a8fa81, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f6b62b55-c282-46ef-a9ba-700f74a8fa81,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:03.923579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:03.949839 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling delete_port for f6b62b55-c282-46ef-a9ba-700f74a8fa81 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:04.104355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:04.119286 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e', '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'f6b62b55-c282-46ef-a9ba-700f74a8fa81'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:04.132605 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260f1113-c9d5-490e-bf14-f6d312815bd7 req-fbe6e4d6-6be3-4f7e-8f6c-733f195b5d23 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:04.135509 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-260f1113-c9d5-490e-bf14-f6d312815bd7 req-fbe6e4d6-6be3-4f7e-8f6c-733f195b5d23 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1560810 Nov 24 16:09:04.139809 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event deleted for resources: {'Port': ['ID=f6b62b55-c282-46ef-a9ba-700f74a8fa81,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:04.199219 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] No DVR routers for this DVR port f6b62b55-c282-46ef-a9ba-700f74a8fa81 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:09:04.202801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:04.205625 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:04.213491 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a185d2f3-8427-434a-8eff-ed466be000f6 req-ff644961-b889-4e56-9d5b-c53fbc0694cf tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "DELETE /v2.0/ports/f6b62b55-c282-46ef-a9ba-700f74a8fa81 HTTP/1.1" status: 204 len: 173 time: 0.5137289 Nov 24 16:09:04.214003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'name': 'network-vif-deleted', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:04.216719 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff4ae74c-0886-4927-b9b1-b3de0794b873" -d '{"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-deleted", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:04.278657 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=dc2bf933-b2d7-4297-b8f9-05a72735f52c,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:04.341230 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4e0d627a-cbc8-406c-ab70-576391301fe9 req-bd97238c-898c-41eb-80b1-a6420da432b8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5d0795a5-a12b-487a-8717-c9e4c33bd48c HTTP/1.1" status: 200 len: 210 time: 0.0525458 Nov 24 16:09:04.417511 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.417862 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.418355 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.418654 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.419016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.419546 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.419897 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.420291 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.420608 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.420947 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.421356 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.421691 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:04.428661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 x-openstack-request-id: req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:04.430217 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-deleted", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:04.430217 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:04.430597 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d0795a5-a12b-487a-8717-c9e4c33bd48c', 'name': 'network-vif-deleted', 'tag': 'f6b62b55-c282-46ef-a9ba-700f74a8fa81', 'status': 'completed', 'code': 200} Nov 24 16:09:04.439591 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-260f1113-c9d5-490e-bf14-f6d312815bd7 req-4f360520-41ab-47d3-9c95-2f4941851d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2547829 Nov 24 16:09:04.586941 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:04.928127 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Router 4579744e-a72c-42e1-b184-5969c9b2caec has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:09:05.111531 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:09:05.118866 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6a0789bc-e4e8-4a6b-bb6c-942e9d0313b0 admin admin] 10.222.0.72 "PUT /v2.0/routers/4579744e-a72c-42e1-b184-5969c9b2caec/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5867834 Nov 24 16:09:05.122222 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35842) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:05.126285 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Sync routers for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:09:05.137982 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:09:05.138667 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:08:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:05.246150 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks [] for router, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:05.325400 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:09:05.369581 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:05.457400 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Deleting port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:05.457935 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:05.560833 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] For port 6ab2d27d-63ea-4073-b58e-fafbd0a79b46, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:05.561474 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:05.591472 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Calling delete_port for 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 owned by network:router_gateway {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:05.631669 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc req-4ba85a18-a250-4172-b1a6-66d06b9aaaba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:05.635937 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc req-4ba85a18-a250-4172-b1a6-66d06b9aaaba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0956442 Nov 24 16:09:05.713309 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83'}], 'enable_snat': True}, 'gw_port_id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:09:04Z', 'revision_number': 5, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port': {'id': '6ab2d27d-63ea-4073-b58e-fafbd0a79b46', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:88:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.83', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:13Z', 'updated_at': '2021-11-24T16:05:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:05.771942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 533d257a-8aad-4722-8f01-84015f80cdd5 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:05.803821 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc req-302d5438-8f27-45d4-999e-8fce624b8a11 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1550088 Nov 24 16:09:05.816119 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Checking router: 4579744e-a72c-42e1-b184-5969c9b2caec for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:09:05.854463 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Routers {'4579744e-a72c-42e1-b184-5969c9b2caec'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:09:05.854463 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:08:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4579744e-a72c-42e1-b184-5969c9b2caec'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:05.857902 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 533d257a-8aad-4722-8f01-84015f80cdd5 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:05.857902 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 533d257a-8aad-4722-8f01-84015f80cdd5 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:05.990314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd98603-8de4-4176-ba19-9772d1979423 req-53063259-b3b1-4bd1-863b-275129316c01 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:05.991942 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-acd98603-8de4-4176-ba19-9772d1979423 req-53063259-b3b1-4bd1-863b-275129316c01 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.0962222 Nov 24 16:09:05.995952 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] Set router 4579744e-a72c-42e1-b184-5969c9b2caec gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:09:06.025012 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.061154 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:09:05Z', 'revision_number': 6, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:06.080326 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Pushing event deleted for resources: {'Port': ['ID=6ab2d27d-63ea-4073-b58e-fafbd0a79b46,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:06.108465 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-acd98603-8de4-4176-ba19-9772d1979423 req-456d17bd-bd18-4b7b-9c67-b203a1325b21 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064622 Nov 24 16:09:06.127437 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08cb57b3-c7b7-43e9-ba24-3800006c7549 None None] The sync data for ids ['4579744e-a72c-42e1-b184-5969c9b2caec'] in dv-cinder-818994-2-iscsi is: [{'id': '4579744e-a72c-42e1-b184-5969c9b2caec', 'name': 'tempest-ServerRescueNegativeTestJSON-1956754642-router', 'tenant_id': '60b309e35e734edbaf96c844838de867', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:09Z', 'updated_at': '2021-11-24T16:09:05Z', 'revision_number': 6, 'project_id': '60b309e35e734edbaf96c844838de867', 'gw_port_host': None}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:09:06.182145 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.190886 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e6c7fee-4788-487f-8997-4f8ec7cac57c req-132a90e6-9ce4-46a7-b464-f369e2452e23 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:06.194503 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7e6c7fee-4788-487f-8997-4f8ec7cac57c req-132a90e6-9ce4-46a7-b464-f369e2452e23 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0916233 Nov 24 16:09:06.269525 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7e6c7fee-4788-487f-8997-4f8ec7cac57c req-7a08b3bb-a1d7-45e3-a523-e1d8d539a243 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672133 Nov 24 16:09:06.304648 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35864) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:06.309966 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.312670 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.402323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.403067 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4579744e-a72c-42e1-b184-5969c9b2caec {{(pid=102787) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:09:06.409972 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.415235 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-98114551-ed9d-4c03-b532-0ffc41b078d7 admin admin] 10.222.0.72 "DELETE /v2.0/routers/4579744e-a72c-42e1-b184-5969c9b2caec HTTP/1.1" status: 204 len: 168 time: 1.2885001 Nov 24 16:09:06.415678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35868) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:06.465739 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Deleting subnet e60a04ed-2a73-4097-a8e3-582d7b1a8d1f {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:09:06.469138 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.509103 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.550165 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0726de59-ed96-4c91-9872-a9a82bbcf9d3 tempest-TestMinimumBasicScenario-1706552953 tempest-TestMinimumBasicScenario-1706552953-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:06.553072 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0726de59-ed96-4c91-9872-a9a82bbcf9d3 tempest-TestMinimumBasicScenario-1706552953 tempest-TestMinimumBasicScenario-1706552953-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1094 time: 0.2461033 Nov 24 16:09:06.556478 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35870) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:06.561517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'port_id': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:06.593448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.751062 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.810150 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.897475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Allocated IP 172.27.0.14 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/0aedd59b-4a4f-4ac3-835c-500fd987bc6e) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:09:06.914061 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.939534 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e60a04ed-2a73-4097-a8e3-582d7b1a8d1f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:06.990821 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:06.994212 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c219be6e-3e0e-46d0-be1b-c0404a8582c3 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/e60a04ed-2a73-4097-a8e3-582d7b1a8d1f HTTP/1.1" status: 204 len: 168 time: 0.5772910 Nov 24 16:09:07.006214 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35884) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:07.064762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.081716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:07.107448 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:07.108347 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 6ab2d27d-63ea-4073-b58e-fafbd0a79b46 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:07.109139 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc2bf933-b2d7-4297-b8f9-05a72735f52c no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:07.119110 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.154821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: dc2bf933-b2d7-4297-b8f9-05a72735f52c {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:07.155361 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc2bf933-b2d7-4297-b8f9-05a72735f52c not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:07.156408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f6a777-2f35-45db-a421-facd4c678c77 req-67092233-7024-4d2a-b992-bfc43e38ed98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:07.166634 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-73f6a777-2f35-45db-a421-facd4c678c77 req-67092233-7024-4d2a-b992-bfc43e38ed98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.2299843 Nov 24 16:09:07.172295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:09:07.176368 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:09:07.187727 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:09:07.191299 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'Port': ['ID=0aedd59b-4a4f-4ac3-835c-500fd987bc6e,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:07.201207 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.276503 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-73f6a777-2f35-45db-a421-facd4c678c77 req-8c2ae58b-21d2-450c-b617-079d897212a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1088459 Nov 24 16:09:07.364003 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.383347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 req-997e0fd1-6dc1-4602-8eb6-913e984af30d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:07.385962 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 req-997e0fd1-6dc1-4602-8eb6-913e984af30d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.1005106 Nov 24 16:09:07.406877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['df42b516-6753-481b-a21c-74d7dd325e73']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:07.426522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:07.427370 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '331e4e5c-9bcb-4bdc-b3e6-31289c608ef3') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:07.448776 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.485254 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.515919 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Releasing vlan 1035 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:09:07.516479 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:09:07.518596 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:09:07.539987 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 req-fef76679-e043-4774-b661-738ca800b3f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423817 Nov 24 16:09:07.624912 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.638460 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:07.645291 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] 10.222.0.72 "DELETE /v2.0/networks/df42b516-6753-481b-a21c-74d7dd325e73 HTTP/1.1" status: 204 len: 168 time: 0.6370468 Nov 24 16:09:07.659340 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a26dd536-1048-4bc6-9609-84beac49b5b5 admin admin] Pushing event deleted for resources: {'Network': ['ID=df42b516-6753-481b-a21c-74d7dd325e73,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:07.772714 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f6b62b55-c282-46ef-a9ba-700f74a8fa81 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:07.811678 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: f6b62b55-c282-46ef-a9ba-700f74a8fa81 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:07.812717 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f6b62b55-c282-46ef-a9ba-700f74a8fa81 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:07.820280 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-d3ab896c-95a4-4aa1-b8da-3ecf056e0267 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:07.822736 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-d3ab896c-95a4-4aa1-b8da-3ecf056e0267 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.2526612 Nov 24 16:09:07.874315 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35898) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:07.951224 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-257944d3-8787-4bc2-af56-34045c8b27af admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=60b309e35e734edbaf96c844838de867&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0755067 Nov 24 16:09:07.955135 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35900) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:07.996413 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.015886 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.042731 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.067636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Deleting port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:08.067998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.124476 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.128066 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.133332 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4b97e978-496d-4df2-91d4-02aa61537c15 HTTP/1.1" status: 204 len: 168 time: 0.1735787 Nov 24 16:09:08.146896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4056a11-79d1-4cfd-8b76-656a4bfa6a85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b97e978-496d-4df2-91d4-02aa61537c15,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:08.407743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.456128 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e req-4b0e3350-3486-4a93-952e-843174af3e03 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:08.458818 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e req-4b0e3350-3486-4a93-952e-843174af3e03 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0563653 Nov 24 16:09:08.484805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] For port 3fa4f539-3c48-40d2-a56f-0717a9dc7259, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3fa4f539-3c48-40d2-a56f-0717a9dc7259,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:08.485250 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.522623 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e req-4783b837-9d74-4ead-9c06-7a5820c57817 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557699 Nov 24 16:09:08.522734 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling delete_port for 3fa4f539-3c48-40d2-a56f-0717a9dc7259 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:08.685687 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.721735 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.848544 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'Port': ['ID=0aedd59b-4a4f-4ac3-835c-500fd987bc6e,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:08.864389 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:08.878603 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e', '3fa4f539-3c48-40d2-a56f-0717a9dc7259'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:08.918355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 req-373b853f-3a64-4392-93fe-9ea3038978b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:08.920636 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 req-373b853f-3a64-4392-93fe-9ea3038978b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=5dbe3561-9e63-4d04-9c0f-563b85fa743f HTTP/1.1" status: 200 len: 946 time: 0.2213519 Nov 24 16:09:08.926300 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event deleted for resources: {'Port': ['ID=3fa4f539-3c48-40d2-a56f-0717a9dc7259,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:08.935003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.028472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] No DVR routers for this DVR port 3fa4f539-3c48-40d2-a56f-0717a9dc7259 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:09:09.036138 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.039993 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f req-51e385b6-756e-45c4-9a11-b714fb11f059 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "DELETE /v2.0/ports/3fa4f539-3c48-40d2-a56f-0717a9dc7259 HTTP/1.1" status: 204 len: 173 time: 1.2082078 Nov 24 16:09:09.040649 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'name': 'network-vif-deleted', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:09.043055 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a67c49d2-ed74-43dd-937e-6d035c4bd311" -d '{"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-deleted", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:09.137068 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e023a3d8-47ec-45c0-a024-343ce40df621 x-openstack-request-id: req-e023a3d8-47ec-45c0-a024-343ce40df621 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:09.137632 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-deleted", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:09.138138 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-e023a3d8-47ec-45c0-a024-343ce40df621 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:09.138845 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dbe3561-9e63-4d04-9c0f-563b85fa743f', 'name': 'network-vif-deleted', 'tag': '3fa4f539-3c48-40d2-a56f-0717a9dc7259', 'status': 'completed', 'code': 200} Nov 24 16:09:09.173356 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 req-c6b50b66-d3eb-481a-9ea2-ec1c61f7dc4c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2431629 Nov 24 16:09:09.200218 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Floating IP 348f83b6-a4f4-4849-97f8-a5b0646e467a associated. External IP: 172.27.0.14, port: fe858985-c82e-488e-aceb-25ed4bffc8ee. Nov 24 16:09:09.455490 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Router 6b4ede60-92bd-4670-939a-9a888194c526 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:09:09.586803 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:09:09.599762 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Sync routers for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:09:09.610370 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.611276 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:09:09.612123 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:08:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:09.648035 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-2da8e9a9-66aa-4067-920d-21c6008885f3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.0867074 Nov 24 16:09:09.649011 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35952) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:09.655985 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1392222549', 'description': 'tempest-secgroup-smoke-1392222549 description', 'project_id': '3b09c1b1b2994015967d00aba299005b'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:09.698167 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9ae546-d876-4c18-9b42-c2bc2cee08de req-41a48039-c2c4-4376-91e3-25bd10c019a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:09.699759 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b9ae546-d876-4c18-9b42-c2bc2cee08de req-41a48039-c2c4-4376-91e3-25bd10c019a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0840323 Nov 24 16:09:09.700956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.745894 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:09:09.790250 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b9ae546-d876-4c18-9b42-c2bc2cee08de req-1a1ddb8a-8b82-4734-9922-2e0652b33063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0778835 Nov 24 16:09:09.860620 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.867564 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.912312 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:09.918732 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35962) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:09.919570 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2687800 Nov 24 16:09:09.925160 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:09.926164 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-680fadc9-4ff9-4165-98a8-4e903194e64d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroup': ['ID=497983bf-eca9-465b-ad1a-9718733e64c7,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:09.970065 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.062720 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.068082 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.091358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc92babf-163d-4232-a504-8d278c5047e5,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:10.103080 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.104680 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-fed8cd90-80ad-4cf3-ac2b-66441c4989a7 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1836889 Nov 24 16:09:10.107457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35970) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.114606 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:10.167612 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.189703 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '348f83b6-a4f4-4849-97f8-a5b0646e467a', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'port_id': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 387, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'mac_address': 'fa:16:3e:2d:23:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:09:07Z', 'updated_at': '2021-11-24T16:09:07Z', 'revision_number': 0, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:10.226059 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Checking router: 6b4ede60-92bd-4670-939a-9a888194c526 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:09:10.236955 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:09:10.238142 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:08:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:10.248386 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.254147 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.282592 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15a612b0-a277-4293-8411-33d17c68961f,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:10.306804 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.310688 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-738074b5-00f4-4775-b688-80293ee1b9ea tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1993234 Nov 24 16:09:10.310919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35986) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.321322 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:10.371081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.396254 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:09:10.479419 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.486363 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.509747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ab5acea-9abf-47a2-80f3-8f8024e8ab55,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:10.516471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.517919 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ac019539-0248-42e0-a7b3-a59484fc6dbb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2057753 Nov 24 16:09:10.521919 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 35990) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.528186 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:10.573684 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.654304 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.655013 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35994) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.661501 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.700698 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1a0c65e3-bab5-47b4-b5da-7351fa96b5a1,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:10.707646 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '348f83b6-a4f4-4849-97f8-a5b0646e467a', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'port_id': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 387, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'mac_address': 'fa:16:3e:2d:23:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:09:07Z', 'updated_at': '2021-11-24T16:09:07Z', 'revision_number': 0, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:10.710871 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.712352 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6802215a-4290-4f69-9041-61936ebb6782 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1887252 Nov 24 16:09:10.715006 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 35998) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.719878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:10.747898 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.securitygroups_db [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Project 3b09c1b1b2994015967d00aba299005b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:09:10.758080 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.806473 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e0e79245-e016-496b-accd-ffef4e0d4749 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.888218 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff16e70d-d559-405f-acd1-cb558fa89317 None None] The sync data for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi is: [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '348f83b6-a4f4-4849-97f8-a5b0646e467a', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'port_id': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 387, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'mac_address': 'fa:16:3e:2d:23:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:09:07Z', 'updated_at': '2021-11-24T16:09:07Z', 'revision_number': 0, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:09:10.905974 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.915431 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.934906 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e38145e-6112-4e85-9e9d-19e23a92a97b,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:10.950029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e0e79245-e016-496b-accd-ffef4e0d4749 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.960347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e0e79245-e016-496b-accd-ffef4e0d4749 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.966868 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:10.968097 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0483e106-8c05-43aa-b11a-ddd7af909e30 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2520308 Nov 24 16:09:10.971427 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36002) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:10.980228 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'security_group_rule': {'security_group_id': '497983bf-eca9-465b-ad1a-9718733e64c7', 'project_id': '3b09c1b1b2994015967d00aba299005b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:10.999236 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5be1861-47cd-42ad-ac50-6a6d061291e9 req-43e92e13-1cb7-4c12-8cea-0ce9acf181c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.001499 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a5be1861-47cd-42ad-ac50-6a6d061291e9 req-43e92e13-1cb7-4c12-8cea-0ce9acf181c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0986857 Nov 24 16:09:11.011494 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e79245-e016-496b-accd-ffef4e0d4749 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce7038df-81e7-4fc0-9ae9-1db2c2935546,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:11.018781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e0e79245-e016-496b-accd-ffef4e0d4749 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=636b9eaaa2d643328bb91cead3fcbca0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3629625 Nov 24 16:09:11.019659 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36004) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:11.048027 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.securitygroups_db [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Project 3b09c1b1b2994015967d00aba299005b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:09:11.063354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.091388 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a5be1861-47cd-42ad-ac50-6a6d061291e9 req-2f1b6282-e71d-4a0b-8f74-64fbb0eac867 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0804060 Nov 24 16:09:11.093871 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.123042 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.140601 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:11.146472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9aa474c-4e52-4082-8039-23dc6dade5a0" -d '{"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:11.169775 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63a3f47b-f663-4f93-ac31-133636f50436 None None] New status for floating IP 348f83b6-a4f4-4849-97f8-a5b0646e467a: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:09:11.174629 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.185519 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.223396 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5227ca94-1370-4213-9a14-08dafc98e822,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:11.231207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-203f14ae-fbf8-493a-b30a-ff089b7a5597 x-openstack-request-id: req-203f14ae-fbf8-493a-b30a-ff089b7a5597 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:11.232647 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:11.240373 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-203f14ae-fbf8-493a-b30a-ff089b7a5597 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:11.244373 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:09:11.254822 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.270885 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-23712996-5f5c-4287-a507-42b28a463812 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2961538 Nov 24 16:09:11.322648 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.327705 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.328887 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ce7038df-81e7-4fc0-9ae9-1db2c2935546 HTTP/1.1" status: 204 len: 168 time: 0.3074667 Nov 24 16:09:11.359384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9990fcc-2655-4816-a4c1-30c2f771be7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce7038df-81e7-4fc0-9ae9-1db2c2935546,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:11.364021 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-eddcfcf6-5273-4ff2-8ec0-e25ad4ef33c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.376450 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-eddcfcf6-5273-4ff2-8ec0-e25ad4ef33c4 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1099 time: 0.1185973 Nov 24 16:09:11.541672 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-9627f05a-c781-4bfb-b3dc-b067cd38ceb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1392222549&fields=id&tenant_id=3b09c1b1b2994015967d00aba299005b HTTP/1.1" status: 200 len: 267 time: 0.1500430 Nov 24 16:09:11.568041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-9935e3df-7e25-497e-9f72-fc78c522cdce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.568528 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-9935e3df-7e25-497e-9f72-fc78c522cdce service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.1769440 Nov 24 16:09:11.639170 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-595fd4db-568e-4a85-b773-134ba601165b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.641934 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-595fd4db-568e-4a85-b773-134ba601165b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0952799 Nov 24 16:09:11.655956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'port': {'security_groups': ['48b8a254-8580-4ea5-aa35-4dfce9b414ab', '497983bf-eca9-465b-ad1a-9718733e64c7']}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:09:11.694502 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-953ab12a-e10d-4173-bf75-80d8d26f590c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 999 time: 0.1163962 Nov 24 16:09:11.763661 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:11.771662 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:09:11.776572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3fa4f539-3c48-40d2-a56f-0717a9dc7259 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:11.795535 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-779ef240-f6c8-47f1-becb-b27615e89a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.797816 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-779ef240-f6c8-47f1-becb-b27615e89a76 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0812223 Nov 24 16:09:11.808078 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 3fa4f539-3c48-40d2-a56f-0717a9dc7259 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:11.808940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3fa4f539-3c48-40d2-a56f-0717a9dc7259 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:11.880899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-c04fa8dc-09fb-43fb-a03a-a353f26a719e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.882468 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-c04fa8dc-09fb-43fb-a03a-a353f26a719e service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0664318 Nov 24 16:09:11.897304 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef req-e74c69ee-4021-4292-85df-d9ea2f7dc3d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:11.898879 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef req-e74c69ee-4021-4292-85df-d9ea2f7dc3d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0922151 Nov 24 16:09:11.973289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:11.986915 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36028) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:11.991893 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:09:12.019820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e4eb6c35-2d59-402c-ac5b-28018d33a5ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.033912 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.035844 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef req-bef39894-1b67-45c2-aa05-86aeecfb42ad tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282248 Nov 24 16:09:12.049826 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:09:12.067653 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-b2e84f94-728a-4256-b013-268f7ebe43a3 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1677144 Nov 24 16:09:12.075303 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:12.080995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.111399 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:12.144279 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=6']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:12.169895 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.179459 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.201356 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:12.218795 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0cc6f513-6305-463b-bb1d-17ec8928f67c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:12.235196 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:12.235921 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.236941 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-5c1c3e0c-59dd-454b-a39c-921db7a1bc53 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1563523 Nov 24 16:09:12.244702 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-30f784b3-5ea2-4c19-99af-505ddda60cc3 req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "PUT /v2.0/ports/fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 982 time: 0.5924747 Nov 24 16:09:12.259622 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e4eb6c35-2d59-402c-ac5b-28018d33a5ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.264376 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:12.267671 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf6bb717-6a37-4d40-a217-16da11ff9e16" -d '{"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:12.278374 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e4eb6c35-2d59-402c-ac5b-28018d33a5ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.306682 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0289e6-9ea4-4f04-a4d9-f158f7873089 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=6']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:12.349709 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e4eb6c35-2d59-402c-ac5b-28018d33a5ce admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=acf2882c051a45159289ac0eca505d50&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3588033 Nov 24 16:09:12.356573 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36036) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:12.357427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:12.371104 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4eb6c35-2d59-402c-ac5b-28018d33a5ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29eca95e-612f-4767-8e5a-2255620acb45,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:12.395003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 req-9243295b-f67a-4a7d-b81d-ac9dac93dd6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:12.403113 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 req-9243295b-f67a-4a7d-b81d-ac9dac93dd6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.1384706 Nov 24 16:09:12.430873 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242ac144-b626-4502-a687-6eb67614abb9 req-b38add35-ae2c-4629-b1a4-616e7d16f38a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:12.434229 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-242ac144-b626-4502-a687-6eb67614abb9 req-b38add35-ae2c-4629-b1a4-616e7d16f38a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0877891 Nov 24 16:09:12.505330 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 req-ab352458-89bb-4ddf-ac21-94248029f70c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1003320 Nov 24 16:09:12.538002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.563989 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.576676 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-242ac144-b626-4502-a687-6eb67614abb9 req-f53d74e1-a44a-4fe5-9652-4b85ec54dc1a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1310349 Nov 24 16:09:12.633249 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f x-openstack-request-id: req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:12.633649 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:12.634000 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:12.634660 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:09:12.713199 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.716521 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.718589 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/29eca95e-612f-4767-8e5a-2255620acb45 HTTP/1.1" status: 204 len: 168 time: 0.3605757 Nov 24 16:09:12.721714 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-c03d5d8d-f120-4f23-97d8-6894614b9080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:12.725206 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-c03d5d8d-f120-4f23-97d8-6894614b9080 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1138 time: 0.0696275 Nov 24 16:09:12.747885 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf8a9f0-cd1a-45e8-81b9-b9b4b9727848 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29eca95e-612f-4767-8e5a-2255620acb45,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:12.823891 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-bac9d5f7-6f12-44a6-bd47-ce5989b81798 None None] Provisioning complete for port fe858985-c82e-488e-aceb-25ed4bffc8ee triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:09:12.824844 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bac9d5f7-6f12-44a6-bd47-ce5989b81798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:12.898922 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-b901be3f-4ca8-4dd0-8d53-7751f375b145 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:12.912019 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-b901be3f-4ca8-4dd0-8d53-7751f375b145 service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.1731758 Nov 24 16:09:12.912364 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36056) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:13.076494 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae1ad2d-6422-4853-ab38-6c87d80ab00b req-09818aea-8a63-4760-a84a-912e30e815d1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:13.078427 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dae1ad2d-6422-4853-ab38-6c87d80ab00b req-09818aea-8a63-4760-a84a-912e30e815d1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1021845 Nov 24 16:09:13.080972 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-831b8040-9aa2-4bd9-a523-ac821328f7e7 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 1001 time: 0.1575403 Nov 24 16:09:13.194284 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-0fb2f9e9-3bb6-410f-9fdd-f8f37c428d3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:13.196024 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-0fb2f9e9-3bb6-410f-9fdd-f8f37c428d3e service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.1053693 Nov 24 16:09:13.216412 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dae1ad2d-6422-4853-ab38-6c87d80ab00b req-c2527d26-6d06-4f88-94d6-04d34b47b3a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1274869 Nov 24 16:09:13.304041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-b09efb20-8f63-41a7-8e99-cd9468631a11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:13.305779 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-b09efb20-8f63-41a7-8e99-cd9468631a11 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0849125 Nov 24 16:09:13.351419 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab28ee3-1daa-410d-9634-f54a45e1cae0 req-2532049f-3a95-46af-9682-69581cd50965 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:13.352983 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1d1575d8-bdf4-48e2-9613-f1cc751aae0c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.355308 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dab28ee3-1daa-410d-9634-f54a45e1cae0 req-2532049f-3a95-46af-9682-69581cd50965 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.1199396 Nov 24 16:09:13.446642 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dab28ee3-1daa-410d-9634-f54a45e1cae0 req-26a324a6-db7b-49e7-afa5-ccc13802dd8d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836413 Nov 24 16:09:13.496864 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-88c56894-4907-44da-ae05-0e0105dfc709 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805964 Nov 24 16:09:13.599750 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1d1575d8-bdf4-48e2-9613-f1cc751aae0c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.607455 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1d1575d8-bdf4-48e2-9613-f1cc751aae0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.695112 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1575d8-bdf4-48e2-9613-f1cc751aae0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67bf01bb-8a2c-455b-9bb2-d6a035b17a61,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:13.700631 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-1d1575d8-bdf4-48e2-9613-f1cc751aae0c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=edb26c5471e14d43b94a047e3ae215b7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7872295 Nov 24 16:09:13.703342 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36082) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:13.708561 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-764bb3f4-1609-4ddd-b74d-d80703d866de service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1938193 Nov 24 16:09:13.732329 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b req-f518952b-525e-469d-9462-d4dc3bdba519 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:13.734214 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b req-f518952b-525e-469d-9462-d4dc3bdba519 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0945351 Nov 24 16:09:13.780786 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.782672 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:09:13.803333 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b req-3a9b30a2-64f2-45c5-9ec7-19cb55fbe46c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613861 Nov 24 16:09:13.806371 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.824241 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.842684 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 0cc6f513-6305-463b-bb1d-17ec8928f67c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:09:13.843113 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.868176 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.870947 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.874661 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/67bf01bb-8a2c-455b-9bb2-d6a035b17a61 HTTP/1.1" status: 204 len: 168 time: 0.1675556 Nov 24 16:09:13.882246 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd04a1a8-5db6-4633-ad64-cf62fe1079e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67bf01bb-8a2c-455b-9bb2-d6a035b17a61,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:13.947182 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:13.977146 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:13.987527 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95d3654c-a838-46cb-830b-b313252b0d91" -d '{"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:14.001715 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:14.007754 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:14.037109 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e109aba-f291-4446-b144-e0005452ecff x-openstack-request-id: req-4e109aba-f291-4446-b144-e0005452ecff {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:14.037531 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:14.038004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4e109aba-f291-4446-b144-e0005452ecff {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:14.038464 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'code': 200} Nov 24 16:09:14.067699 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=7']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:14.340967 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3894a43-25ea-4b82-86a4-858b470a6e83 req-7f07a52a-2eb8-4a54-b677-2beb3d347266 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:14.342613 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e3894a43-25ea-4b82-86a4-858b470a6e83 req-7f07a52a-2eb8-4a54-b677-2beb3d347266 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0516994 Nov 24 16:09:14.396262 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e3894a43-25ea-4b82-86a4-858b470a6e83 req-eb610231-03d9-4a53-b53e-33bab804a7d1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462778 Nov 24 16:09:14.525753 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-91c4bea3-6c94-4000-891b-0e5bd98a555c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:14.527883 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-91c4bea3-6c94-4000-891b-0e5bd98a555c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0714414 Nov 24 16:09:14.596453 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-737b88d7-264c-4a29-be3c-ce71d76fac60 req-66bb3015-12b9-431d-b198-2d58a89b70ca tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:14.598889 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-737b88d7-264c-4a29-be3c-ce71d76fac60 req-66bb3015-12b9-431d-b198-2d58a89b70ca tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 945 time: 0.0625999 Nov 24 16:09:14.652591 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Deleting port 691eb29c-951c-4f72-b283-76d5f14e961e {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:09:14.653120 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:14.656643 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-737b88d7-264c-4a29-be3c-ce71d76fac60 req-0ec7134c-f9c0-4ff2-b92b-106bbbd60d43 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/security-groups?id=529346e9-ab6d-4a44-8109-45445b3ecb84&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514603 Nov 24 16:09:14.764773 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] For port 691eb29c-951c-4f72-b283-76d5f14e961e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=691eb29c-951c-4f72-b283-76d5f14e961e,segment=NetworkSegment(02833ec3-3410-4203-939b-a89b1f0c3745),segment_id=02833ec3-3410-4203-939b-a89b1f0c3745)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:14.765240 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:14.793890 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling delete_port for 691eb29c-951c-4f72-b283-76d5f14e961e owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:09:14.998727 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 req-5d776e36-5722-4fd7-a850-dc49b551dca7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:15.000524 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 req-5d776e36-5722-4fd7-a850-dc49b551dca7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0938601 Nov 24 16:09:15.018386 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:15.039120 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['691eb29c-951c-4f72-b283-76d5f14e961e'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:09:15.060046 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Pushing event deleted for resources: {'Port': ['ID=691eb29c-951c-4f72-b283-76d5f14e961e,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:15.109600 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 req-3cf311d4-6b4e-4718-852c-c375c520a08f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0989766 Nov 24 16:09:15.125180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] No DVR routers for this DVR port 691eb29c-951c-4f72-b283-76d5f14e961e on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:09:15.128076 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:15.132699 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae req-6014d1a6-db96-494b-a7ac-9159a30ce05a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.71 "DELETE /v2.0/ports/691eb29c-951c-4f72-b283-76d5f14e961e HTTP/1.1" status: 204 len: 173 time: 0.5946527 Nov 24 16:09:15.133224 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'name': 'network-vif-deleted', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:15.135624 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78982bdd-e95a-4196-ac03-bd3013b88e0a" -d '{"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-deleted", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:15.235111 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20eeb879-f9e3-4508-89e2-9ca48fa51809 x-openstack-request-id: req-20eeb879-f9e3-4508-89e2-9ca48fa51809 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:15.235650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-deleted", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:15.236107 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-20eeb879-f9e3-4508-89e2-9ca48fa51809 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:15.236829 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7e069fb-95d8-4964-b82d-ca884fcb2b5e', 'name': 'network-vif-deleted', 'tag': '691eb29c-951c-4f72-b283-76d5f14e961e', 'status': 'completed', 'code': 200} Nov 24 16:09:15.534326 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 req-5186224f-aec7-4496-9577-71210f7da54f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:15.535806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 req-5186224f-aec7-4496-9577-71210f7da54f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0581870 Nov 24 16:09:15.587331 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 req-1826064f-a56e-4cc8-ac94-d48581a73a22 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454617 Nov 24 16:09:15.773404 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 req-29debc78-5393-48ed-a15c-92728f703017 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /v2.0/ports?device_id=c7e069fb-95d8-4964-b82d-ca884fcb2b5e HTTP/1.1" status: 200 len: 210 time: 0.0287180 Nov 24 16:09:16.298018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df5b0021-5317-4eab-96ec-5a37168e95e0 req-9d35038b-759d-475e-8d9a-6de0cd3d836a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:16.300166 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-df5b0021-5317-4eab-96ec-5a37168e95e0 req-9d35038b-759d-475e-8d9a-6de0cd3d836a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0667384 Nov 24 16:09:16.364401 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-df5b0021-5317-4eab-96ec-5a37168e95e0 req-a4feeaf4-2342-414e-81d8-b0883705fa90 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558436 Nov 24 16:09:16.737652 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad req-b554de28-cb60-4d0d-8580-fa2c7f596251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:16.742103 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad req-b554de28-cb60-4d0d-8580-fa2c7f596251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0612893 Nov 24 16:09:16.818059 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad req-2e7009ef-a3c1-4269-968b-6427bfd62eb5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0705192 Nov 24 16:09:16.849609 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36164) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:16.906789 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Deleting subnet d3e375f9-d96e-4117-a4ce-55baac3893ba {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:09:16.912702 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:16.968486 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.043844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.133804 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.171326 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.178964 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] 10.222.0.72 "DELETE /v2.0/subnets/d3e375f9-d96e-4117-a4ce-55baac3893ba HTTP/1.1" status: 204 len: 168 time: 0.3281016 Nov 24 16:09:17.180435 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b05b82-9b37-4fdd-aa02-55daff2e0bdd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d3e375f9-d96e-4117-a4ce-55baac3893ba,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:17.189608 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36172) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:17.306247 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.416372 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.441825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fafb4435-765d-4616-9638-8248f7ef836b']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:17.463440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '02833ec3-3410-4203-939b-a89b1f0c3745') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:17.464007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '02833ec3-3410-4203-939b-a89b1f0c3745') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:09:17.483413 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.504890 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.515608 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Releasing vlan 1015 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:09:17.516016 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:09:17.518268 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:09:17.536501 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b229559d-1a83-4bb7-bed8-35cdfb6d266f req-19b98bcc-bf3d-41be-bfe5-695350abbc66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:17.538459 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b229559d-1a83-4bb7-bed8-35cdfb6d266f req-19b98bcc-bf3d-41be-bfe5-695350abbc66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0752239 Nov 24 16:09:17.606846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.627639 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b229559d-1a83-4bb7-bed8-35cdfb6d266f req-f47bc7ae-2d4e-4460-9b72-889627638531 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818229 Nov 24 16:09:17.628018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:17.631755 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] 10.222.0.72 "DELETE /v2.0/networks/fafb4435-765d-4616-9638-8248f7ef836b HTTP/1.1" status: 204 len: 168 time: 0.4402051 Nov 24 16:09:17.632779 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b091355-bb5c-4f94-95e5-e04bc71e3548 admin admin] Pushing event deleted for resources: {'Network': ['ID=fafb4435-765d-4616-9638-8248f7ef836b,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:17.786779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 691eb29c-951c-4f72-b283-76d5f14e961e no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:17.868411 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 691eb29c-951c-4f72-b283-76d5f14e961e {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:09:17.869316 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 691eb29c-951c-4f72-b283-76d5f14e961e not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:09:18.071481 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36186) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:18.116104 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 req-4916652e-67b6-4ae2-80c6-ba255b05d570 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:18.121099 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 req-4916652e-67b6-4ae2-80c6-ba255b05d570 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1970346 Nov 24 16:09:18.147818 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-911f43d6-42d6-4009-b6f6-b190a0e8cf24 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=20c9176ab8ef44ffb17eda5f41aca2a8&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0750635 Nov 24 16:09:18.152769 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36188) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:18.263187 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 req-9b846fde-e667-4749-a8bc-4e3c2cdc3b10 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1393085 Nov 24 16:09:18.280419 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:18.335122 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:18.416160 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:18.422615 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:18.427681 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/529346e9-ab6d-4a44-8109-45445b3ecb84 HTTP/1.1" status: 204 len: 168 time: 0.2700303 Nov 24 16:09:18.438708 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a53a21e5-0c05-4c1c-b794-b01bef09511e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=529346e9-ab6d-4a44-8109-45445b3ecb84,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:18.634307 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-35fd733a-c7a8-4b04-bd82-64290f7575c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:18.887702 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c215bd77-dc2b-4cad-b679-64c42d261ad2 req-fbf7a1a0-3d87-43af-a923-54b9985b488c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:18.901598 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c215bd77-dc2b-4cad-b679-64c42d261ad2 req-fbf7a1a0-3d87-43af-a923-54b9985b488c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.1415937 Nov 24 16:09:19.007499 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c215bd77-dc2b-4cad-b679-64c42d261ad2 req-c385639e-e061-4304-9f3a-d9c55b3f98d5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1043136 Nov 24 16:09:19.732781 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678899c2-b005-4104-8c71-4a5eef8c2b0e req-e811a350-3cbf-43e1-bc82-e9ef0b953708 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:19.741155 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-678899c2-b005-4104-8c71-4a5eef8c2b0e req-e811a350-3cbf-43e1-bc82-e9ef0b953708 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.3309474 Nov 24 16:09:19.807110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-678899c2-b005-4104-8c71-4a5eef8c2b0e req-d8a3525c-fd78-4529-b753-8d9a1abf2145 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0589352 Nov 24 16:09:20.200318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f969263f-0890-4581-9462-098aa094f0eb req-f831ab2a-44ac-496d-9a80-86e167d657a9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:20.220680 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f969263f-0890-4581-9462-098aa094f0eb req-f831ab2a-44ac-496d-9a80-86e167d657a9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0960019 Nov 24 16:09:20.381934 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f969263f-0890-4581-9462-098aa094f0eb req-9788fb43-7f03-4cbb-b97b-6e3be0734771 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1600811 Nov 24 16:09:20.965246 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f948618-6103-4ca5-b3c7-9da199f85d9e req-3dd28c44-15b6-44ae-9220-f1c5c8d398a7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:20.968632 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1f948618-6103-4ca5-b3c7-9da199f85d9e req-3dd28c44-15b6-44ae-9220-f1c5c8d398a7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0829794 Nov 24 16:09:21.051040 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1f948618-6103-4ca5-b3c7-9da199f85d9e req-628afd52-c514-4822-ab0b-3c616115e860 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0718551 Nov 24 16:09:21.261797 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5f3e93c6-bc3d-4f76-8233-2f7ed607e176 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:21.540344 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 req-4ecbd622-0b78-45dc-9c27-92994c948fd9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:21.541903 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 req-4ecbd622-0b78-45dc-9c27-92994c948fd9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0633099 Nov 24 16:09:21.604456 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 req-155e68e7-b802-4ae8-a61b-93ae57abdee6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560496 Nov 24 16:09:22.207619 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee66559-5d8d-4639-bee3-9fa09a87bae6 req-480082db-b25d-4ed6-85c1-8f54cc574bcb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:22.209517 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dee66559-5d8d-4639-bee3-9fa09a87bae6 req-480082db-b25d-4ed6-85c1-8f54cc574bcb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0781174 Nov 24 16:09:22.275557 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dee66559-5d8d-4639-bee3-9fa09a87bae6 req-0ea2e52d-2aaa-4ba4-9fb4-c82982d72438 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588617 Nov 24 16:09:22.636814 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:22.796000 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8123551-687f-4ca0-a833-9b47c40234f4 req-2f6604ff-9ecd-4bb9-8192-98f3cdb58238 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:22.797371 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a8123551-687f-4ca0-a833-9b47c40234f4 req-2f6604ff-9ecd-4bb9-8192-98f3cdb58238 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0853598 Nov 24 16:09:22.856433 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a8123551-687f-4ca0-a833-9b47c40234f4 req-983d32df-9c32-48d9-a996-f1668dc4db43 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515044 Nov 24 16:09:23.497941 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41805308-b190-48de-9255-cd4eb423a0ec req-ff51c645-2d5e-4f42-ab9c-3205633b352a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:23.500726 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-41805308-b190-48de-9255-cd4eb423a0ec req-ff51c645-2d5e-4f42-ab9c-3205633b352a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1351900 Nov 24 16:09:23.600258 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-41805308-b190-48de-9255-cd4eb423a0ec req-5901a7ac-e418-4c2d-ae60-fc024f3a8e92 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0905805 Nov 24 16:09:24.031528 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3751a56-71bb-4741-82ec-0ceb69ea067f req-51a6334f-7bb7-44aa-acec-15435f8e6a81 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:24.035676 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d3751a56-71bb-4741-82ec-0ceb69ea067f req-51a6334f-7bb7-44aa-acec-15435f8e6a81 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0806415 Nov 24 16:09:24.118318 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d3751a56-71bb-4741-82ec-0ceb69ea067f req-d1234a53-e564-42f3-9881-22b957fb0d5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721483 Nov 24 16:09:24.329232 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:24.453016 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:24.749147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca71e2f0-4778-4817-bae8-860376c5fb2b req-cd7df1dc-f565-4a5b-8fa9-caf7078ca154 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:24.752791 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ca71e2f0-4778-4817-bae8-860376c5fb2b req-cd7df1dc-f565-4a5b-8fa9-caf7078ca154 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0641854 Nov 24 16:09:24.848182 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ca71e2f0-4778-4817-bae8-860376c5fb2b req-accaea09-af3a-45df-8139-7e1a3e29b845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0873277 Nov 24 16:09:25.313878 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf26e65-787d-481f-9012-eaf216bc8cb0 req-269ad71e-9887-462d-86f3-4ff3bd9f9e57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:25.328344 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bcf26e65-787d-481f-9012-eaf216bc8cb0 req-269ad71e-9887-462d-86f3-4ff3bd9f9e57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0824945 Nov 24 16:09:25.393887 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bcf26e65-787d-481f-9012-eaf216bc8cb0 req-a90bc34b-91f4-4850-8a14-3003ae56e7ae tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643208 Nov 24 16:09:26.011203 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-985e0080-c35d-4014-8205-53d68ccb8b67 req-24c80743-217f-4a93-aa28-4b2e6836c585 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:26.013749 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-985e0080-c35d-4014-8205-53d68ccb8b67 req-24c80743-217f-4a93-aa28-4b2e6836c585 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0655973 Nov 24 16:09:26.072669 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-985e0080-c35d-4014-8205-53d68ccb8b67 req-f10c21de-6d69-4bde-86e2-db8426a30c78 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512490 Nov 24 16:09:26.553815 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdd907c-c565-4d5d-8808-7bfb9189acdd req-ccc05afc-b009-4165-8ce1-730a17ae4747 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:26.555363 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8cdd907c-c565-4d5d-8808-7bfb9189acdd req-ccc05afc-b009-4165-8ce1-730a17ae4747 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0849593 Nov 24 16:09:26.678332 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8cdd907c-c565-4d5d-8808-7bfb9189acdd req-a4a3ac1c-fe39-4f6d-935e-c9dd65d109e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1149580 Nov 24 16:09:27.241568 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a req-0be3d1fc-aac2-4eaf-9694-96afb30689c4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:27.243274 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a req-0be3d1fc-aac2-4eaf-9694-96afb30689c4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0854027 Nov 24 16:09:27.294231 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a req-dfd86219-d691-4de9-b0db-6084a9d5c6c6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445004 Nov 24 16:09:27.806185 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 req-6fea7d27-472a-453a-aa7a-0cc1413065cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:27.807683 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 req-6fea7d27-472a-453a-aa7a-0cc1413065cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0522723 Nov 24 16:09:27.854483 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 req-c615709d-1b3e-45f9-946c-42bf09798388 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408919 Nov 24 16:09:28.427795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37957667-32fa-4628-bde6-0da27b77b376 req-6a5a5a5a-b4a5-4376-8d16-67be02971caa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:28.429295 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-37957667-32fa-4628-bde6-0da27b77b376 req-6a5a5a5a-b4a5-4376-8d16-67be02971caa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0542574 Nov 24 16:09:28.476166 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-37957667-32fa-4628-bde6-0da27b77b376 req-5d62430d-f700-45ac-ab0f-8c9e511484fc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409126 Nov 24 16:09:28.974802 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c9b31b-3eea-47f0-a1de-ac754a9667fd req-297e44d6-d82c-4d10-81b0-5990ea6f87cd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:28.976189 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-11c9b31b-3eea-47f0-a1de-ac754a9667fd req-297e44d6-d82c-4d10-81b0-5990ea6f87cd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0490191 Nov 24 16:09:29.022400 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-11c9b31b-3eea-47f0-a1de-ac754a9667fd req-1e74e8d9-bff4-4276-89b8-e588d1498999 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403283 Nov 24 16:09:29.596025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd49eabb-472d-4a12-9430-baae941be1e5 req-72cfc4c5-e43a-439e-a44c-63fcf3684e86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:29.597472 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cd49eabb-472d-4a12-9430-baae941be1e5 req-72cfc4c5-e43a-439e-a44c-63fcf3684e86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0517361 Nov 24 16:09:29.645950 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cd49eabb-472d-4a12-9430-baae941be1e5 req-422492bd-391e-49b6-b110-f09e21685472 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423069 Nov 24 16:09:30.146720 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3388827-a8db-42a5-9c08-1274fb08c63b req-410bbb7f-bdea-460e-a814-da8798745ce8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.148122 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f3388827-a8db-42a5-9c08-1274fb08c63b req-410bbb7f-bdea-460e-a814-da8798745ce8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0545268 Nov 24 16:09:30.195153 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f3388827-a8db-42a5-9c08-1274fb08c63b req-2934373b-d001-4992-9c3a-f4b875e134a7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409684 Nov 24 16:09:30.645660 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-b79fcfb3-77ef-4f84-b7af-aac3694f5dfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.647228 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-b79fcfb3-77ef-4f84-b7af-aac3694f5dfd service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1098 time: 0.0507143 Nov 24 16:09:30.750391 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-c4ec0a5c-b930-4942-8e25-545c5c6e8807 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.751938 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-c4ec0a5c-b930-4942-8e25-545c5c6e8807 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0976341 Nov 24 16:09:30.792303 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e req-bbeba608-8973-42d7-ad24-b804eddce312 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.794619 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e req-bbeba608-8973-42d7-ad24-b804eddce312 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0715454 Nov 24 16:09:30.825469 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-b8037fa8-be11-4ed6-9475-afeae677f514 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 1001 time: 0.0646458 Nov 24 16:09:30.849432 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e req-14ce293a-55bc-4824-90d9-b65310a73e9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474076 Nov 24 16:09:30.889053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-e221225d-e90d-44c6-867c-f9ee3837bbdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.891982 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-e221225d-e90d-44c6-867c-f9ee3837bbdd service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0589604 Nov 24 16:09:30.953347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-8d035c1d-a0d1-43f3-be10-aed678fc5ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:30.954868 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-8d035c1d-a0d1-43f3-be10-aed678fc5ea4 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0552216 Nov 24 16:09:31.078081 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-69663a03-107a-4995-8aca-267bf163e788 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1127608 Nov 24 16:09:31.199740 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 req-23aad511-6b12-41f8-9696-58de247bb6f0 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1135724 Nov 24 16:09:31.330474 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652e0461-2825-4ff3-993d-506ae2af3741 req-a7782800-b3bc-4e04-8593-4b4969004c63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:31.332488 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-652e0461-2825-4ff3-993d-506ae2af3741 req-a7782800-b3bc-4e04-8593-4b4969004c63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0541425 Nov 24 16:09:31.345997 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36446) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:31.387616 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-652e0461-2825-4ff3-993d-506ae2af3741 req-ed7bac83-448a-473a-9b7c-d8f75ea2b0da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486302 Nov 24 16:09:31.465173 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9eefaca6-52b9-45d9-88cd-05fb25c6c00e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.543998 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9eefaca6-52b9-45d9-88cd-05fb25c6c00e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.547220 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9eefaca6-52b9-45d9-88cd-05fb25c6c00e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.592383 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9eefaca6-52b9-45d9-88cd-05fb25c6c00e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=11af7abd99014d0e95e169ae8a96e8de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2447600 Nov 24 16:09:31.593104 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eefaca6-52b9-45d9-88cd-05fb25c6c00e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0d15c8c-2446-4b33-9c45-9bf9b5b4b14a,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:31.595699 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36450) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:31.652855 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.676383 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.728578 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.731334 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:31.732481 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f0d15c8c-2446-4b33-9c45-9bf9b5b4b14a HTTP/1.1" status: 204 len: 168 time: 0.1355553 Nov 24 16:09:31.741304 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24fa3dcf-ea76-4676-b1cc-b2787c3fbbd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0d15c8c-2446-4b33-9c45-9bf9b5b4b14a,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:31.981456 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67d39ac-c92d-46d7-af17-5e798903a7e1 req-897052b8-350c-482a-8174-3fb0d6b23f29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:31.983072 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d67d39ac-c92d-46d7-af17-5e798903a7e1 req-897052b8-350c-482a-8174-3fb0d6b23f29 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0559006 Nov 24 16:09:32.040236 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d67d39ac-c92d-46d7-af17-5e798903a7e1 req-264acb71-e0fe-450f-aec3-3217831a031f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504632 Nov 24 16:09:32.045497 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36458) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:32.060897 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdfb4d3f-597a-494f-8298-bcbb69689c17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.153983 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdfb4d3f-597a-494f-8298-bcbb69689c17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.160018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fdfb4d3f-597a-494f-8298-bcbb69689c17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.208376 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-fdfb4d3f-597a-494f-8298-bcbb69689c17 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=cc4d09b4683a4fd8ae18de3d74f55355&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1612377 Nov 24 16:09:32.209985 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfb4d3f-597a-494f-8298-bcbb69689c17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce290e56-168f-4748-86b8-e61425d52c3d,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:32.210972 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36470) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:32.264573 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.285791 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.334084 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.336740 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.337940 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ce290e56-168f-4748-86b8-e61425d52c3d HTTP/1.1" status: 204 len: 168 time: 0.1254034 Nov 24 16:09:32.346283 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b12de59-ba77-4245-8194-380c83e52329 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce290e56-168f-4748-86b8-e61425d52c3d,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:32.521345 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36486) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:32.532209 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addcacc-e089-468b-9669-d5a6694794f2 req-1f6527d3-3e77-4411-b1a6-5d404bbc92c3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:32.534284 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9addcacc-e089-468b-9669-d5a6694794f2 req-1f6527d3-3e77-4411-b1a6-5d404bbc92c3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0659454 Nov 24 16:09:32.592856 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9addcacc-e089-468b-9669-d5a6694794f2 req-d8ea45b6-c9c3-49a0-a211-59b60dcf9ac6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516949 Nov 24 16:09:32.639152 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b7ac48be-2a70-4175-93b3-db7b03c080e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.718556 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b7ac48be-2a70-4175-93b3-db7b03c080e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.722965 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b7ac48be-2a70-4175-93b3-db7b03c080e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.763669 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b7ac48be-2a70-4175-93b3-db7b03c080e0 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8f3f932b1cc34d408f5ee2b61bff7443&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2411768 Nov 24 16:09:32.764689 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ac48be-2a70-4175-93b3-db7b03c080e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39a83f0c-0869-46a7-a260-7d8aafc012d2,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:32.766699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36498) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:32.833128 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.861464 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.916720 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.919383 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:32.920603 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/39a83f0c-0869-46a7-a260-7d8aafc012d2 HTTP/1.1" status: 204 len: 168 time: 0.1525295 Nov 24 16:09:32.928916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1316da9b-0429-4f7e-88e4-bec2941a0f36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39a83f0c-0869-46a7-a260-7d8aafc012d2,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:33.187409 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f req-b8453ae8-efde-43e2-b001-8c8580095d7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:33.189392 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f req-b8453ae8-efde-43e2-b001-8c8580095d7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0672405 Nov 24 16:09:33.254743 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f req-f608289e-60fe-4242-b2d0-540a28370043 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0581634 Nov 24 16:09:33.725424 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26711582-5214-42db-8254-8d3b17dde322 req-e96802de-3b58-4489-af88-0ed8ab00d522 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:33.727023 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26711582-5214-42db-8254-8d3b17dde322 req-e96802de-3b58-4489-af88-0ed8ab00d522 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 945 time: 0.0565238 Nov 24 16:09:33.781751 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26711582-5214-42db-8254-8d3b17dde322 req-11637dfc-5cd6-4623-9cdc-2fc36efeb801 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482228 Nov 24 16:09:33.871202 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:33.969215 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:33.994291 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:09:33.996707 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-332b9c0d-6204-4e39-a56f-1224c1e87e88" -d '{"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-unplugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:09:34.011398 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:09:34.019897 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:34.069942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 24 Nov 2021 16:09:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66373f46-d6cd-4b6c-a190-40258820980c x-openstack-request-id: req-66373f46-d6cd-4b6c-a190-40258820980c {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:09:34.070483 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-unplugged", "status": "failed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "code": 422}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:09:34.070975 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-66373f46-d6cd-4b6c-a190-40258820980c {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:09:34.071550 dv-cinder-818994-2-iscsi neutron-server[102789]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'code': 422} returned with failed status Nov 24 16:09:34.103266 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=8']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:34.367511 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-adea89cc-b100-46f3-8217-fbdca334559c req-f04a8dcb-078e-4869-bc89-8fd8614609e5 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:09:34.368617 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-adea89cc-b100-46f3-8217-fbdca334559c req-f04a8dcb-078e-4869-bc89-8fd8614609e5 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058851 Nov 24 16:09:34.417973 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 req-72f66483-12a9-4908-a15f-6a33ab49c87a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:34.419621 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 req-72f66483-12a9-4908-a15f-6a33ab49c87a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0534916 Nov 24 16:09:34.478954 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 req-440c9854-3568-4d9c-a5e0-79aac3cc2af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527046 Nov 24 16:09:34.546016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 req-0a1947f3-6b85-4871-a775-6bf652acc9bb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:34.548543 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 req-0a1947f3-6b85-4871-a775-6bf652acc9bb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0563123 Nov 24 16:09:34.642406 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 req-d2c56537-0fa4-4cb1-97ef-a02191f06817 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859337 Nov 24 16:09:34.842181 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef3574d-380c-40b4-8ef5-e2edf63337fb req-94a784ca-6e8d-4041-ba86-5641906fb64a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:34.851924 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ef3574d-380c-40b4-8ef5-e2edf63337fb req-94a784ca-6e8d-4041-ba86-5641906fb64a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.1146855 Nov 24 16:09:34.881081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-f5bee7f9-d9ef-4912-991d-3f41dbd9327d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:34.883138 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-f5bee7f9-d9ef-4912-991d-3f41dbd9327d service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1098 time: 0.0917919 Nov 24 16:09:34.949340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8ef3574d-380c-40b4-8ef5-e2edf63337fb req-46bcff1a-0f38-473d-81fc-38d56cd30470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0963128 Nov 24 16:09:35.021206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36632) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:35.027211 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-8501c804-fca6-4398-8324-50ce93265271 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:35.028726 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-8501c804-fca6-4398-8324-50ce93265271 service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.1357069 Nov 24 16:09:35.102350 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-edae993e-5ff0-416c-90da-a82708b5284a service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 1001 time: 0.0664663 Nov 24 16:09:35.110600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36636) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:35.154328 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-919e407a-6bc3-478e-b14c-8338c878d9bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:35.156028 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-919e407a-6bc3-478e-b14c-8338c878d9bc service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0471463 Nov 24 16:09:35.167612 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-6a69fdbc-bce8-4439-814c-b453592495a9 service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1449924 Nov 24 16:09:35.178664 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-f64b2285-4f0c-4ab5-a6ee-1720adaf1221 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:09:35.181492 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-f64b2285-4f0c-4ab5-a6ee-1720adaf1221 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0071614 Nov 24 16:09:35.182662 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ca24eec-8854-4040-8be4-40073520bc57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.205767 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-650b8c42-36bd-4c6f-8e39-835f55512ddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:35.208348 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-650b8c42-36bd-4c6f-8e39-835f55512ddb service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0454485 Nov 24 16:09:35.282869 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ca24eec-8854-4040-8be4-40073520bc57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.288539 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5ca24eec-8854-4040-8be4-40073520bc57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.302376 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-afbd0362-7430-41d0-b775-6946e939099c service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864928 Nov 24 16:09:35.335316 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5ca24eec-8854-4040-8be4-40073520bc57 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e6f19dd278ee47029323a2ffbc094966&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2236502 Nov 24 16:09:35.336812 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca24eec-8854-4040-8be4-40073520bc57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f453794c-fe45-4ec3-b471-30b08613debd,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:35.340181 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36646) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:35.402077 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.422857 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a37c3c07-f80b-41d2-97da-6d3c40c95528 req-d45cad55-556d-4136-a4c8-bbb01b5d46ee service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1124332 Nov 24 16:09:35.433207 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.509616 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.513301 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:35.516804 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f453794c-fe45-4ec3-b471-30b08613debd HTTP/1.1" status: 204 len: 168 time: 0.1735325 Nov 24 16:09:35.525642 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dfcb939-3a6c-44cb-9b78-1437b306d61d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f453794c-fe45-4ec3-b471-30b08613debd,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:35.806554 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 req-3048bb1c-2f68-43cf-8bf5-b850d0d64088 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:35.817395 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 req-3048bb1c-2f68-43cf-8bf5-b850d0d64088 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0914929 Nov 24 16:09:35.895077 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 req-a2b7355a-24a7-4382-ba74-fb2edb00d2c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0766361 Nov 24 16:09:35.977383 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36664) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:35.991289 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9ecb967-1564-4876-9450-018ad323395e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.080253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9ecb967-1564-4876-9450-018ad323395e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.080559 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 req-e558400e-e615-4e54-8577-0195d17b072f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:36.083282 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 req-e558400e-e615-4e54-8577-0195d17b072f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0558045 Nov 24 16:09:36.085796 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-c9ecb967-1564-4876-9450-018ad323395e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.125482 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ecb967-1564-4876-9450-018ad323395e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc22d09a-3498-4ae2-bdd5-e7c59a46bfde,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:36.132007 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-c9ecb967-1564-4876-9450-018ad323395e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3d63354eac7b46cbb3be81a434b73593&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1534543 Nov 24 16:09:36.132976 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36668) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:36.144143 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 req-12ff61e4-beb9-4e64-9d58-67e931da3969 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519345 Nov 24 16:09:36.185751 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.208367 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.257530 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.260616 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:36.262236 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/bc22d09a-3498-4ae2-bdd5-e7c59a46bfde HTTP/1.1" status: 204 len: 168 time: 0.1280603 Nov 24 16:09:36.271003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a333d452-1340-4b32-b06b-326c82884273 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc22d09a-3498-4ae2-bdd5-e7c59a46bfde,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:37.002703 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:09:37.025898 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf req-b64f841b-bc04-4606-87bf-95250f71e98e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.027388 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf req-b64f841b-bc04-4606-87bf-95250f71e98e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0541151 Nov 24 16:09:37.078116 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf req-1c6027d8-b1f8-4a32-a656-2878983c63cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441523 Nov 24 16:09:37.303675 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-e7b09fd9-cc0c-408e-96eb-7dd7a5f550e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.305921 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-e7b09fd9-cc0c-408e-96eb-7dd7a5f550e0 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 1096 time: 0.1661615 Nov 24 16:09:37.319225 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42b5636-c701-494e-afc0-1bb26680d20a req-bdcdac40-d062-461e-9ec6-0e936b81217a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.325767 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a42b5636-c701-494e-afc0-1bb26680d20a req-bdcdac40-d062-461e-9ec6-0e936b81217a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0904300 Nov 24 16:09:37.404309 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-87fe1b3b-97de-4138-9df8-82b7a858a690 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.405728 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-87fe1b3b-97de-4138-9df8-82b7a858a690 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1096 time: 0.0775340 Nov 24 16:09:37.409658 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a42b5636-c701-494e-afc0-1bb26680d20a req-3f095fb7-5930-460b-bb91-2a6e9e1c2df3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0794663 Nov 24 16:09:37.495163 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-05fadfd6-8bbb-4a5f-8c57-4557200312a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.496617 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-05fadfd6-8bbb-4a5f-8c57-4557200312a7 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0836048 Nov 24 16:09:37.571023 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-4030a3f0-5515-41b5-b0f7-24ddb4997a9d service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 999 time: 0.0664997 Nov 24 16:09:37.629124 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-df1cf171-0f14-492c-a530-8e5f1ef6549d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.630828 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-df1cf171-0f14-492c-a530-8e5f1ef6549d service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0530734 Nov 24 16:09:37.677592 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-6854a009-70d2-4ec3-bdfc-a6405b019b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:37.679208 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-6854a009-70d2-4ec3-bdfc-a6405b019b3a service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415967 Nov 24 16:09:37.778642 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-350deafc-e546-4c33-bc98-a233dbabb926 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921376 Nov 24 16:09:37.869819 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ecbcd4b4-50b5-4139-8751-8a9beed48515 req-6b8e3345-0cbc-4b31-8de8-a29825b8ceb4 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828619 Nov 24 16:09:37.884196 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:09:38.202491 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1741f1-4ded-4436-a456-561777adace7 req-201f51ed-94c4-4a44-8855-54b19e4a2a2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:38.203879 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0c1741f1-4ded-4436-a456-561777adace7 req-201f51ed-94c4-4a44-8855-54b19e4a2a2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0497870 Nov 24 16:09:38.278139 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0c1741f1-4ded-4436-a456-561777adace7 req-e5b1b8c7-5c2c-4826-af35-a44b8789126b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671883 Nov 24 16:09:39.420066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01618f82-2487-4e4c-be1d-c2f95ba3010a req-b312749a-dd8d-4f72-9e2d-4d8769293723 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:39.421637 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01618f82-2487-4e4c-be1d-c2f95ba3010a req-b312749a-dd8d-4f72-9e2d-4d8769293723 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0564854 Nov 24 16:09:39.472466 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01618f82-2487-4e4c-be1d-c2f95ba3010a req-11ed6c3d-fa88-444b-9b85-b6c658d296f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446377 Nov 24 16:09:40.621515 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d255e362-ec5e-448a-95df-f109cd805eb8 req-f93624be-8fbe-4ff8-9544-534ec95a6cb5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:40.623768 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d255e362-ec5e-448a-95df-f109cd805eb8 req-f93624be-8fbe-4ff8-9544-534ec95a6cb5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0704107 Nov 24 16:09:40.678037 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d255e362-ec5e-448a-95df-f109cd805eb8 req-0e744a1e-ce09-4f76-9b30-c5c83271726b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453234 Nov 24 16:09:40.854384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36818) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:40.976542 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.068015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.072012 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.111502 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=32e3f1538559479ea01806103616b9ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2560079 Nov 24 16:09:41.112532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82abf79a-fa82-41fc-893d-baefd41c9156,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:41.114381 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36824) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:41.119970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.120321 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.120672 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.121020 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.121382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.121725 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.122052 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.122385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.122746 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.123051 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.123402 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.123704 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16a9ca2e-7656-490b-89ef-b14e30bacbb1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:09:41.180696 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.213442 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.275690 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.278795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.283379 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/82abf79a-fa82-41fc-893d-baefd41c9156 HTTP/1.1" status: 204 len: 168 time: 0.1677177 Nov 24 16:09:41.292558 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5641da51-e133-425a-8197-a56b498518c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82abf79a-fa82-41fc-893d-baefd41c9156,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:41.607674 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36836) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:41.621549 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-59e63d6c-3280-4d5c-a6cd-5e42a112ec42 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.707141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-59e63d6c-3280-4d5c-a6cd-5e42a112ec42 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.711685 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-59e63d6c-3280-4d5c-a6cd-5e42a112ec42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.751609 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e63d6c-3280-4d5c-a6cd-5e42a112ec42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8607653b-77f5-40f2-ad10-80831f216359,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:41.764011 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-59e63d6c-3280-4d5c-a6cd-5e42a112ec42 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d1c57a228fd54616a9c4f7d1365f86e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1552689 Nov 24 16:09:41.766580 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36842) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:41.827291 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.831799 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d req-53e79485-45d8-496b-802c-c637070e7cfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:41.837637 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d req-53e79485-45d8-496b-802c-c637070e7cfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0633702 Nov 24 16:09:41.855872 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.895669 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d req-a3077958-df6c-4dee-b2c1-dde5ab0dd13e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567913 Nov 24 16:09:41.912745 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.916038 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:41.917339 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8607653b-77f5-40f2-ad10-80831f216359 HTTP/1.1" status: 204 len: 168 time: 0.1497905 Nov 24 16:09:41.934634 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443a9d4e-932b-4286-9c16-1d3c06bbdafc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8607653b-77f5-40f2-ad10-80831f216359,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:43.032672 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c64677a2-564f-4488-a399-d1f0b937bf0b req-9798d58b-f3cb-4d9a-a868-9b2dfdfe3f2f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:43.035101 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c64677a2-564f-4488-a399-d1f0b937bf0b req-9798d58b-f3cb-4d9a-a868-9b2dfdfe3f2f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0541797 Nov 24 16:09:43.095574 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c64677a2-564f-4488-a399-d1f0b937bf0b req-73592815-39ca-4a74-935a-ea5de7d62af1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543528 Nov 24 16:09:43.794636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:43.852464 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36910) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:43.885004 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36914) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:44.012188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb80dd2-6a51-4031-b00e-d39f539512f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.053984 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ef48af3d-3a6c-4419-8edd-4845af1aeb1b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.104404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb80dd2-6a51-4031-b00e-d39f539512f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.112513 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0bb80dd2-6a51-4031-b00e-d39f539512f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.150893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ef48af3d-3a6c-4419-8edd-4845af1aeb1b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.160925 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ef48af3d-3a6c-4419-8edd-4845af1aeb1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.187362 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0bb80dd2-6a51-4031-b00e-d39f539512f3 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5a265028bdb742b787be0a96522cdee8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3011756 Nov 24 16:09:44.188811 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb80dd2-6a51-4031-b00e-d39f539512f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56978e60-0416-4813-81a5-59c457b25d74,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:44.191665 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36920) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:44.230576 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ef48af3d-3a6c-4419-8edd-4845af1aeb1b admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1d55d6bb6ff94ca981479b88bb2bc767&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3769023 Nov 24 16:09:44.232885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef48af3d-3a6c-4419-8edd-4845af1aeb1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb9a2a38-cc12-4a71-9f23-76959b2a0306,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:44.237109 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36922) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:44.284709 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.295149 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6637a1c-a9db-4453-bb3e-a2d429893b7d req-27877e56-6a17-40e0-a369-b7e526fca59c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:44.296885 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6637a1c-a9db-4453-bb3e-a2d429893b7d req-27877e56-6a17-40e0-a369-b7e526fca59c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0874574 Nov 24 16:09:44.322649 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.332426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.359081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.387958 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6637a1c-a9db-4453-bb3e-a2d429893b7d req-f3384117-2cce-4a93-8b76-9b3f92ae68d0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0823674 Nov 24 16:09:44.417532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.417532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.417532 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/56978e60-0416-4813-81a5-59c457b25d74 HTTP/1.1" status: 204 len: 168 time: 0.2241664 Nov 24 16:09:44.430118 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.432483 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.436393 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/fb9a2a38-cc12-4a71-9f23-76959b2a0306 HTTP/1.1" status: 204 len: 168 time: 0.1982610 Nov 24 16:09:44.440883 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317d3c12-a6b8-45ad-8345-a3282ea85f5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56978e60-0416-4813-81a5-59c457b25d74,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:44.455563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6db19f-4be9-42d3-ba4f-309d647a3317 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb9a2a38-cc12-4a71-9f23-76959b2a0306,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:44.822677 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36932) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:44.835327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36934) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:44.836108 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f5c81693-b353-403c-82ab-bbc28e8f6591 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.849883 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ab7ed607-017e-4316-ba73-035b0b7495b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.932258 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f5c81693-b353-403c-82ab-bbc28e8f6591 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.937272 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f5c81693-b353-403c-82ab-bbc28e8f6591 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.958254 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ab7ed607-017e-4316-ba73-035b0b7495b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.965619 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ab7ed607-017e-4316-ba73-035b0b7495b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:44.982969 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f5c81693-b353-403c-82ab-bbc28e8f6591 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=93917ab648424a6ca4ece2144b08c8e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1591830 Nov 24 16:09:44.984095 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5c81693-b353-403c-82ab-bbc28e8f6591 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01564165-3617-42b6-8874-7b4da91c8623,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:44.987389 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 36936) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:45.028688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7ed607-017e-4316-ba73-035b0b7495b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19224f4e-e287-40be-b303-befc8f84509c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:45.036086 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ab7ed607-017e-4316-ba73-035b0b7495b8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d175b55cceb2426b8d253cf376570dc2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1963801 Nov 24 16:09:45.036899 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 36938) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:09:45.068738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.097867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.099906 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.125932 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.165440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.168030 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.171575 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/01564165-3617-42b6-8874-7b4da91c8623 HTTP/1.1" status: 204 len: 168 time: 0.1791785 Nov 24 16:09:45.191558 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c9fbd1-6c3f-464b-8e49-3f5ae9d65012 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01564165-3617-42b6-8874-7b4da91c8623,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:45.197870 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.200538 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:45.202784 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/19224f4e-e287-40be-b303-befc8f84509c HTTP/1.1" status: 204 len: 168 time: 0.1651292 Nov 24 16:09:45.226503 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa025e4-8ff8-46cf-a31d-71b2317409e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19224f4e-e287-40be-b303-befc8f84509c,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:09:45.561344 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64ed595-8052-41dc-a57b-118979af9925 req-c480f4a1-876d-430f-b1b3-27b693ef0c53 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:45.574697 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e64ed595-8052-41dc-a57b-118979af9925 req-c480f4a1-876d-430f-b1b3-27b693ef0c53 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0904377 Nov 24 16:09:45.681597 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e64ed595-8052-41dc-a57b-118979af9925 req-b7b4b5e1-9ca1-481a-8afd-41fde93a169e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0954804 Nov 24 16:09:46.826360 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da req-fca6f493-3361-4e01-be06-966a88bac896 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:46.827970 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da req-fca6f493-3361-4e01-be06-966a88bac896 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0575905 Nov 24 16:09:46.886363 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da req-461fc209-ff50-463a-968f-1d661c5f4447 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517178 Nov 24 16:09:48.021542 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 req-1655733f-d6db-4a26-9b00-f007d6d6242b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:48.022962 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 req-1655733f-d6db-4a26-9b00-f007d6d6242b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0503716 Nov 24 16:09:48.073770 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 req-a566c1bc-329a-4445-b4cc-ea3df8be87bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442026 Nov 24 16:09:48.608339 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-14b02b75-f792-4509-9206-0d6e229d2bf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:49.200053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efaf29d-046a-4441-aaae-b543247205a4 req-7c95b3c8-439b-47b1-ae59-aeb67f59701f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:49.201463 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5efaf29d-046a-4441-aaae-b543247205a4 req-7c95b3c8-439b-47b1-ae59-aeb67f59701f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0490015 Nov 24 16:09:49.253709 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5efaf29d-046a-4441-aaae-b543247205a4 req-35b98382-cab5-4247-b2ba-f02635207afc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449548 Nov 24 16:09:50.375378 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803cdf32-6e56-4735-9ca9-a4d8571d7601 req-e630163e-b3be-4aa8-bf82-80e764a275ae tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:50.376907 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-803cdf32-6e56-4735-9ca9-a4d8571d7601 req-e630163e-b3be-4aa8-bf82-80e764a275ae tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0493734 Nov 24 16:09:50.422975 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-803cdf32-6e56-4735-9ca9-a4d8571d7601 req-444f3d99-703e-43b0-81b2-fba937d3bcfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402639 Nov 24 16:09:51.257685 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a64cc981-34bd-4e3f-a6a6-12c9f53a6e77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:51.551547 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 req-525c614f-d028-49c5-a9de-75e3ddba03b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:51.552995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 req-525c614f-d028-49c5-a9de-75e3ddba03b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0543566 Nov 24 16:09:51.602341 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 req-ab021dd3-c9cf-4bd5-a657-1b9092f97a91 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433700 Nov 24 16:09:52.628951 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:52.726055 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b899b62-f67f-4f1d-bff5-9e12d90f878f req-6bd8b5b1-640c-4ee6-b509-93fb5bec76cd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:52.727477 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1b899b62-f67f-4f1d-bff5-9e12d90f878f req-6bd8b5b1-640c-4ee6-b509-93fb5bec76cd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0510156 Nov 24 16:09:52.775135 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1b899b62-f67f-4f1d-bff5-9e12d90f878f req-f9af946c-d8d0-45b1-bc77-8ab16db41590 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417392 Nov 24 16:09:53.895293 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 req-cbbbe387-dd5c-4664-bc3b-0afbb0a8b5b3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:53.897021 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 req-cbbbe387-dd5c-4664-bc3b-0afbb0a8b5b3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0496266 Nov 24 16:09:53.945130 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 req-f74913b2-afc4-47ca-a625-bbff75e2e450 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418141 Nov 24 16:09:54.315485 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:54.452443 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:09:55.064515 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 req-08b49160-fc32-47eb-b842-2ad25fed3bc8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:55.066095 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 req-08b49160-fc32-47eb-b842-2ad25fed3bc8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0492444 Nov 24 16:09:55.118743 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 req-4a5d74e4-901c-4a38-a6c5-a644c7a908e3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467629 Nov 24 16:09:56.245474 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f10e22-b770-48da-a808-83cbb2cafa58 req-2b15c487-ded4-4fdb-a11c-757f3eac2bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:56.246951 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-57f10e22-b770-48da-a808-83cbb2cafa58 req-2b15c487-ded4-4fdb-a11c-757f3eac2bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0524428 Nov 24 16:09:56.295345 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-57f10e22-b770-48da-a808-83cbb2cafa58 req-c3698935-d0eb-45ab-bd48-ec79f9308efc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420175 Nov 24 16:09:57.421672 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 req-39fb71c1-f014-4387-b3ec-91048b087e70 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:57.423140 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 req-39fb71c1-f014-4387-b3ec-91048b087e70 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0528460 Nov 24 16:09:57.470136 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 req-d7f9dd51-3897-4246-85d7-dda460542065 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404563 Nov 24 16:09:58.600456 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a6461f-162b-44a2-abd4-69906bfe9a22 req-189b379e-898d-4d59-a981-f4c35a1debc4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:58.601883 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e4a6461f-162b-44a2-abd4-69906bfe9a22 req-189b379e-898d-4d59-a981-f4c35a1debc4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0495794 Nov 24 16:09:58.649692 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e4a6461f-162b-44a2-abd4-69906bfe9a22 req-f87195e4-84b0-4cbc-9430-4860cf097a4b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413852 Nov 24 16:09:59.773116 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a963636-671f-44da-a5ea-f779c0241699 req-59178f7b-6bef-493f-89f2-5816ae901246 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:09:59.774662 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a963636-671f-44da-a5ea-f779c0241699 req-59178f7b-6bef-493f-89f2-5816ae901246 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0505445 Nov 24 16:09:59.821294 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a963636-671f-44da-a5ea-f779c0241699 req-19884967-e92b-4ae8-b91b-4f770ab06a9f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407145 Nov 24 16:10:00.941590 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 req-85e55d95-c431-4c6c-a1c4-9de56012fe86 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:00.943245 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 req-85e55d95-c431-4c6c-a1c4-9de56012fe86 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0485523 Nov 24 16:10:00.994120 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 req-14f1b909-9d8a-4528-a71e-dcfed038c554 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434732 Nov 24 16:10:02.115076 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f609981-54e9-4317-b87a-26414ab1c94e req-8018ce8a-72b1-4990-b593-acc64c2a8e8a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:02.116488 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0f609981-54e9-4317-b87a-26414ab1c94e req-8018ce8a-72b1-4990-b593-acc64c2a8e8a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0489681 Nov 24 16:10:02.166671 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0f609981-54e9-4317-b87a-26414ab1c94e req-7676c473-bd5d-412c-8ab5-c08ea26d4f8a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442567 Nov 24 16:10:03.287117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed req-603dfc4b-d26a-4cce-90d9-a0f7527b08db tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:03.288612 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed req-603dfc4b-d26a-4cce-90d9-a0f7527b08db tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0482137 Nov 24 16:10:03.336415 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed req-65151e4f-ddbf-4661-9b7d-d81919b0f691 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414655 Nov 24 16:10:04.455617 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 req-ed8fe922-d405-4aa9-8b9f-da88ee8db55f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:04.457096 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 req-ed8fe922-d405-4aa9-8b9f-da88ee8db55f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0480187 Nov 24 16:10:04.505372 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 req-e1b2a91d-3e73-4256-8fb6-a83191caa8e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423381 Nov 24 16:10:05.641394 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced3571b-2a97-4610-8efe-ff35660a804e req-5780d40a-765e-4201-bb58-17bd18244f10 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:05.643662 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ced3571b-2a97-4610-8efe-ff35660a804e req-5780d40a-765e-4201-bb58-17bd18244f10 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0597146 Nov 24 16:10:05.694732 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ced3571b-2a97-4610-8efe-ff35660a804e req-9daeb019-9b7b-4049-8552-7d06981d20bb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427527 Nov 24 16:10:06.830284 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb6d7d7-7605-4013-95df-abbb985a0ddf req-18f354c6-8341-41fc-8451-f1ac817074e4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:06.832247 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9bb6d7d7-7605-4013-95df-abbb985a0ddf req-18f354c6-8341-41fc-8451-f1ac817074e4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0601344 Nov 24 16:10:06.885256 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9bb6d7d7-7605-4013-95df-abbb985a0ddf req-82d34987-08bb-4e0a-b33b-8a1e334bfcbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465600 Nov 24 16:10:07.185048 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37190) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:07.306323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.387299 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.391650 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.432687 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54f30187-c9ed-4e78-b141-3d3c4d49722d,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:07.436682 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=7ab2007f646c4a90896a8522b8275daf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2504623 Nov 24 16:10:07.440505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 37194) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:07.444086 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.444325 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.444609 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.444956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.445391 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.445766 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.446108 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.446453 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.446835 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.447167 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.447561 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.447896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf344b52-234c-4489-8a97-9ecc22e806a8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:07.532496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.567285 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.625996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.629850 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:07.631366 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/54f30187-c9ed-4e78-b141-3d3c4d49722d HTTP/1.1" status: 204 len: 168 time: 0.1891046 Nov 24 16:10:07.641647 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ef69a7-00e3-4551-8579-b1ca47b8a05f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54f30187-c9ed-4e78-b141-3d3c4d49722d,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:07.927622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37200) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:07.944864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-578f54c0-39c2-47b3-8a56-1752cd7ac795 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.053626 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-578f54c0-39c2-47b3-8a56-1752cd7ac795 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.057483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c38695-6b13-44bd-ac71-69cc49c11d88 req-1c3e0430-1e37-44c4-87ac-bb94edc6f335 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:08.058864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-578f54c0-39c2-47b3-8a56-1752cd7ac795 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.059351 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26c38695-6b13-44bd-ac71-69cc49c11d88 req-1c3e0430-1e37-44c4-87ac-bb94edc6f335 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0769429 Nov 24 16:10:08.102237 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-578f54c0-39c2-47b3-8a56-1752cd7ac795 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=45a2604c7bb7468eb9f63e7c8dfb29c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1719213 Nov 24 16:10:08.102237 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578f54c0-39c2-47b3-8a56-1752cd7ac795 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f22da1f-91d6-4acb-ad1a-9c202e636876,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:08.103582 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 37206) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:08.123153 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26c38695-6b13-44bd-ac71-69cc49c11d88 req-038a01ad-019b-40e1-a229-d6afa081c7be tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567899 Nov 24 16:10:08.162491 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.191018 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.249871 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.252971 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:08.254151 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6f22da1f-91d6-4acb-ad1a-9c202e636876 HTTP/1.1" status: 204 len: 168 time: 0.1495900 Nov 24 16:10:08.262654 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08dda8d6-d061-4c36-b43b-3259dddab290 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f22da1f-91d6-4acb-ad1a-9c202e636876,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:09.413120 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37246) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:09.439897 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c00ad37-8efa-4811-a532-d1f9dee80d35 req-30b7bbfc-fc40-40bd-a936-c3579dbaac5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:09.441595 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3c00ad37-8efa-4811-a532-d1f9dee80d35 req-30b7bbfc-fc40-40bd-a936-c3579dbaac5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.2417347 Nov 24 16:10:09.503548 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3c00ad37-8efa-4811-a532-d1f9dee80d35 req-f5ee4577-84e5-4b89-a5eb-1d8ba47aebab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548105 Nov 24 16:10:09.526109 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1c68c7c-14b2-4139-b955-64fd3cb1fd17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.616639 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1c68c7c-14b2-4139-b955-64fd3cb1fd17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.621705 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b1c68c7c-14b2-4139-b955-64fd3cb1fd17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.663238 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b1c68c7c-14b2-4139-b955-64fd3cb1fd17 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5d7b0cf3db514463b617b4058f1cecda&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2488623 Nov 24 16:10:09.663825 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c68c7c-14b2-4139-b955-64fd3cb1fd17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54ae48a2-f714-4a03-90e7-06f8dd8454e9,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:09.665927 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 37250) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:09.715789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.737870 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.784344 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.786998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:09.788147 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/54ae48a2-f714-4a03-90e7-06f8dd8454e9 HTTP/1.1" status: 204 len: 168 time: 0.1211030 Nov 24 16:10:09.795607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e120ff11-0b4c-4c02-8a7b-906e2f9182a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54ae48a2-f714-4a03-90e7-06f8dd8454e9,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:10.805666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ea653b-bc53-4183-bba0-509be95d5f96 req-09fdea32-5785-4744-b7bd-40146b3fbbf0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:10.807211 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-17ea653b-bc53-4183-bba0-509be95d5f96 req-09fdea32-5785-4744-b7bd-40146b3fbbf0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.2207558 Nov 24 16:10:10.856147 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-17ea653b-bc53-4183-bba0-509be95d5f96 req-256214dc-a6dd-4763-9ebf-892edc4b41be tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425866 Nov 24 16:10:11.980889 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec647de-d838-442e-bd0f-df124708dde0 req-c1bb8f82-cf64-4eba-9774-0670c39d6773 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:11.982407 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7ec647de-d838-442e-bd0f-df124708dde0 req-c1bb8f82-cf64-4eba-9774-0670c39d6773 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0497074 Nov 24 16:10:12.035168 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7ec647de-d838-442e-bd0f-df124708dde0 req-4dc16c92-9add-4e4e-9151-0f17cd8f5018 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457888 Nov 24 16:10:13.167885 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3278e1af-024d-44c9-a2f3-9a07204c9d9d req-e0ce0f05-6f4d-41f4-86dd-b1797ceecb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:13.169500 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3278e1af-024d-44c9-a2f3-9a07204c9d9d req-e0ce0f05-6f4d-41f4-86dd-b1797ceecb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0576510 Nov 24 16:10:13.221015 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3278e1af-024d-44c9-a2f3-9a07204c9d9d req-5e733841-a9cf-4db9-b1aa-e0ccb03b70ef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441549 Nov 24 16:10:13.796911 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:14.001705 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:10:14.462334 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d req-bbc90cbe-02a3-4295-adf9-1d2f2b3b7045 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:14.463969 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d req-bbc90cbe-02a3-4295-adf9-1d2f2b3b7045 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.1651452 Nov 24 16:10:14.512432 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d req-622518ff-7264-4c7d-b18d-50543a8c11dd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424347 Nov 24 16:10:15.645293 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5fa31d-5907-4821-876d-c8e8325ddddf req-4da4ff3e-2b0f-4711-a663-e9237e1c776b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:15.646815 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0e5fa31d-5907-4821-876d-c8e8325ddddf req-4da4ff3e-2b0f-4711-a663-e9237e1c776b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 943 time: 0.0534866 Nov 24 16:10:15.700137 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0e5fa31d-5907-4821-876d-c8e8325ddddf req-154a2435-179b-42dc-904e-4ee82744a44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469291 Nov 24 16:10:16.095568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:10:16.203754 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:16.218012 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'mac_address': 'fa:16:3e:61:9b:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:10:16.268396 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:16.287981 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:10:16.308567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:16.312150 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:16.360553 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=9']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:16.368290 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.368674 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.369047 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.369395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.369736 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.370179 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.370406 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.370755 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.371087 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.371465 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.371736 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.372066 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:16.687748 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0cc6f513-6305-463b-bb1d-17ec8928f67c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:10:16.844362 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe445f3-5302-4c14-a99e-d84dff33c26f req-3e26b31f-7d96-445a-9817-f28cead6b2b0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:16.846010 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bbe445f3-5302-4c14-a99e-d84dff33c26f req-3e26b31f-7d96-445a-9817-f28cead6b2b0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.0564492 Nov 24 16:10:16.896274 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bbe445f3-5302-4c14-a99e-d84dff33c26f req-ac86beff-9c01-4b6e-94a6-54495e8ebac2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438130 Nov 24 16:10:17.630249 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-b36af678-e1ed-4b49-befd-c9f4c2c6ebec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:17.631723 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-b36af678-e1ed-4b49-befd-c9f4c2c6ebec service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1097 time: 0.0481656 Nov 24 16:10:17.746671 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 37410) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:17.783720 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-b74b3f63-fa7c-45d7-8ec5-ca1c14e990cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:17.785255 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-b74b3f63-fa7c-45d7-8ec5-ca1c14e990cd service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.1279976 Nov 24 16:10:17.858259 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-d2847e6d-adfe-4920-8613-91662789c83c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 200 len: 1000 time: 0.0653002 Nov 24 16:10:18.112665 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:10:18.151662 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ff2603b8-86b9-4a5a-823d-d1c3d6f6ea0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.171522 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 0cc6f513-6305-463b-bb1d-17ec8928f67c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:10:18.171895 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.184102 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-114c46d1-7963-411d-ad9d-c5461e751aa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:18.185626 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-114c46d1-7963-411d-ad9d-c5461e751aa2 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.3195972 Nov 24 16:10:18.256887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e065723-c065-44a5-bf66-2b58f7a05811 req-8ed4f2eb-d2dd-494c-b902-75326c4da8f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:18.258760 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1e065723-c065-44a5-bf66-2b58f7a05811 req-8ed4f2eb-d2dd-494c-b902-75326c4da8f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 944 time: 0.1259148 Nov 24 16:10:18.260034 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.299389 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-04141dfc-9d2d-41b6-aece-8fdc0be0ba88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:18.300962 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-04141dfc-9d2d-41b6-aece-8fdc0be0ba88 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1062117 Nov 24 16:10:18.306948 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:18.309379 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de3637b6-91a4-4d43-87c4-5bcbc84680de" -d '{"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:18.331179 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:18.339407 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.385941 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-302d122d-86bb-4a11-b206-7cef5617bcd8 x-openstack-request-id: req-302d122d-86bb-4a11-b206-7cef5617bcd8 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:18.386699 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:18.387159 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-302d122d-86bb-4a11-b206-7cef5617bcd8 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:18.387939 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'code': 200} Nov 24 16:10:18.423187 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1e065723-c065-44a5-bf66-2b58f7a05811 req-6f887363-5e20-460c-80fe-de676ccf1918 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1483605 Nov 24 16:10:18.426944 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=10']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:18.442831 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ff2603b8-86b9-4a5a-823d-d1c3d6f6ea0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.459430 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ff2603b8-86b9-4a5a-823d-d1c3d6f6ea0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.490379 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-4f46d341-335e-499c-9c3f-a0dfd59c45a4 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1797497 Nov 24 16:10:18.529712 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ff2603b8-86b9-4a5a-823d-d1c3d6f6ea0a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=7d54cf8cfb5b4d578fbef9667261bba5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7819641 Nov 24 16:10:18.533206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37420) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:18.539840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2603b8-86b9-4a5a-823d-d1c3d6f6ea0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e71e94a-a044-454c-8bbd-ec66bdef111e,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:18.592042 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.605267 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-bdf17f9a-c009-4dbf-88bc-590e8363d167 req-0ab0387f-77b3-4589-9f9d-8996192b7047 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1060338 Nov 24 16:10:18.624958 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4a398948-9402-46bc-bc05-20dd4b813956 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.635022 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.692102 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.694748 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:18.695900 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/1e71e94a-a044-454c-8bbd-ec66bdef111e HTTP/1.1" status: 204 len: 168 time: 0.1602862 Nov 24 16:10:18.705055 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1a2c80-40ee-4a1d-ab53-6a2ba2a812c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e71e94a-a044-454c-8bbd-ec66bdef111e,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:18.973308 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0b6c5f-3d79-43d9-ac3f-02c5afc68e62 req-e746073f-c831-40da-8efa-fb251aa371a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:18.976372 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d0b6c5f-3d79-43d9-ac3f-02c5afc68e62 req-e746073f-c831-40da-8efa-fb251aa371a3 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 1099 time: 0.0500486 Nov 24 16:10:19.045270 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2d0b6c5f-3d79-43d9-ac3f-02c5afc68e62 req-b8fff4e8-0f4b-443f-b1c7-52de2c5df38b service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604751 Nov 24 16:10:19.557760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 37448) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:19.581704 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06981f7a-a591-42e7-8b03-bebca49f96b7 req-fab552f6-89d0-42f9-8d45-8d1050da326d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:19.583298 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-06981f7a-a591-42e7-8b03-bebca49f96b7 req-fab552f6-89d0-42f9-8d45-8d1050da326d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0613368 Nov 24 16:10:19.644686 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-06981f7a-a591-42e7-8b03-bebca49f96b7 req-de954fee-5370-48a5-acc0-fe6a85e9531c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549514 Nov 24 16:10:19.685896 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1433940146-network', 'tenant_id': '342ef6b52f7f4b9a87df95d6eaaad436'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:19.707171 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Made reservation on behalf of 342ef6b52f7f4b9a87df95d6eaaad436 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:10:19.709579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.718768 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.804711 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.809134 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.839381 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1006} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:10:19.849762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:19.854850 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.855184 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Added segment a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c of type vlan for network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 Nov 24 16:10:19.912313 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.944379 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.945533 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:19.946247 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:19.985423 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4261785 Nov 24 16:10:19.991315 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37452) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:19.997196 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Request body: {'subnet': {'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1433940146-subnet', 'tenant_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:20.021201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee3f1d5-126a-4a08-9082-b3727c907b73 admin admin] Pushing event updated for resources: {'Network': ['ID=0f425afc-3f71-4bdb-94b6-fb87f034ecf4,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:20.032152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:10:20.040149 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Made reservation on behalf of 342ef6b52f7f4b9a87df95d6eaaad436 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:10:20.042617 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:20.232674 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:20.287602 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:20.301144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Checking segment: {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:10:20.301623 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Network hostable DHCP agents. Network: 0f425afc-3f71-4bdb-94b6-fb87f034ecf4, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:10:20.321289 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:10:20.331314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 0f425afc-3f71-4bdb-94b6-fb87f034ecf4) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:10:20.335992 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:20.336576 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:20.342022 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71e355f4-59dd-4798-8069-5250a2d8a834 None None] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:10:20.354310 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a40aef51-209a-4b58-bd29-be558f7fe6af admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3614523 Nov 24 16:10:20.658685 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-269f8373-ce8e-4b78-b9ed-5c1e2e0d3d61 None None] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:10:20.827835 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38748da7-a35b-493a-b269-536c56b57589 req-f33f7815-74a5-4f3e-993e-398b2251558f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:20.830859 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-38748da7-a35b-493a-b269-536c56b57589 req-f33f7815-74a5-4f3e-993e-398b2251558f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0906708 Nov 24 16:10:20.893478 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-38748da7-a35b-493a-b269-536c56b57589 req-cda6a9ae-9c48-42fa-b49f-9b8f66a29216 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549750 Nov 24 16:10:21.263633 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-213c9c68-3602-44f5-a786-30a37aa5c428 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:22.037207 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003922af-5223-427f-9abd-e7a2f9690f3d req-0d24b694-414a-44ae-927b-dca82f98aa0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:22.038693 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-003922af-5223-427f-9abd-e7a2f9690f3d req-0d24b694-414a-44ae-927b-dca82f98aa0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0658958 Nov 24 16:10:22.096243 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-003922af-5223-427f-9abd-e7a2f9690f3d req-747cb4fd-bd9e-4fcd-9ea4-e5e1c2be8cd4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505829 Nov 24 16:10:22.351855 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-605c2241-628a-4306-a4d1-762f3036e45e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:22.353413 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-605c2241-628a-4306-a4d1-762f3036e45e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 809 time: 0.1204426 Nov 24 16:10:22.370844 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-bd7da734-099d-442c-9f5a-487769c6e03c tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/quotas/342ef6b52f7f4b9a87df95d6eaaad436 HTTP/1.1" status: 200 len: 375 time: 0.0114415 Nov 24 16:10:22.406662 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-ed84f8c0-337f-4b56-9a76-1f467922f143 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0292039 Nov 24 16:10:22.555160 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-adb833d7-1761-4453-8356-868ad982c35a service neutron] 10.222.0.72 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1399786 Nov 24 16:10:22.639571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:22.659098 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-009825c7-4fec-46ba-a23a-7d30e953b112 service neutron] 10.222.0.72 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0978343 Nov 24 16:10:22.850625 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6d852e0c-2c4b-4d13-96c1-cdc2dfd0e175 req-f31c803b-3dff-4491-b2a9-bbf2def59b95 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 210 time: 0.0274634 Nov 24 16:10:23.955804 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 req-2aedfc50-690e-4852-8d95-2bd02cd59d6c tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 210 time: 0.0280166 Nov 24 16:10:24.282224 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-2d800a4f-0eee-4db0-871a-3f852292a684 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:24.283775 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-2d800a4f-0eee-4db0-871a-3f852292a684 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 809 time: 0.1457217 Nov 24 16:10:24.305811 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Request body: {'port': {'device_id': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4', 'admin_state_up': True, 'tenant_id': '342ef6b52f7f4b9a87df95d6eaaad436'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:24.331238 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.436571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Made reservation on behalf of 342ef6b52f7f4b9a87df95d6eaaad436 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:10:24.440394 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.468785 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.595842 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Allocated IP 172.20.0.6 (0f425afc-3f71-4bdb-94b6-fb87f034ecf4/a3d0fe7c-77a4-4bca-b667-996a7fad1c6a/0ef17b69-6b2d-4dcb-8260-0e3639cb1149) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:10:24.777246 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.816413 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.870829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:10:24.874192 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:10:24.880058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:10:24.884187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Pushing event updated for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:24.955709 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:24.956839 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:24.982954 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-cda4e6b4-eea4-434e-8a9c-4079189adea8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6817086 Nov 24 16:10:25.075017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Request body: {'port': {'device_id': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:25.089295 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb50fdd-8663-4f37-8781-f2bdc145f497 req-a1e96067-7c6d-48dc-9f66-0378de12ac10 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:25.090955 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7eb50fdd-8663-4f37-8781-f2bdc145f497 req-a1e96067-7c6d-48dc-9f66-0378de12ac10 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 931 time: 0.0632248 Nov 24 16:10:25.152447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.166655 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7eb50fdd-8663-4f37-8781-f2bdc145f497 req-c6bfb96c-bb9c-431e-93da-51a09b2a4640 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638840 Nov 24 16:10:25.464960 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:10:25.472698 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.484578 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Transition to ACTIVE for port object 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:10:25.488957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.543472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Pushing event updated for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:25.608958 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Attempting to bind port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:10:25.609332 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Attempting to bind port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:10:25.609665 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Attempting to bind port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:10:25.614509 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:10:25.614833 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Attempting to bind port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:10:25.619857 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 10, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:10:25.620200 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Checking segment: {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:10:25.620592 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Bound using segment: {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:10:25.621108 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Bound port: 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:10:25.621409 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.701002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:10:25.705340 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:10:25.711047 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.747536 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:25.748167 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:25.749975 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] 10.222.0.71 "PUT /v2.0/ports/0ef17b69-6b2d-4dcb-8260-0e3639cb1149 HTTP/1.1" status: 200 len: 1093 time: 0.6813455 Nov 24 16:10:25.751037 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:25.753854 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-183a66ea-6138-4b64-8e04-a738fd29f6a8" -d '{"events": [{"name": "network-changed", "server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:25.780823 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd267f5-ec02-41c3-a0e3-6e0a8f30daf2 service neutron] Pushing event updated for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:25.832528 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9295eb76-aa3f-46d8-8264-ded6eee1af97 x-openstack-request-id: req-9295eb76-aa3f-46d8-8264-ded6eee1af97 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:25.832829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:25.833116 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-9295eb76-aa3f-46d8-8264-ded6eee1af97 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:25.833521 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149', 'status': 'completed', 'code': 200} Nov 24 16:10:25.849863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-62dd77b4-de71-4a49-bbf3-0233bcc56d6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:25.851395 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-62dd77b4-de71-4a49-bbf3-0233bcc56d6b service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 1096 time: 0.0544205 Nov 24 16:10:25.897561 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-2e5867d6-d23b-4817-bfb5-b961d8343f4a service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149 HTTP/1.1" status: 200 len: 217 time: 0.0363514 Nov 24 16:10:25.951477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-65261812-bbb5-450b-9d17-0dba25d11b05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:25.952968 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-65261812-bbb5-450b-9d17-0dba25d11b05 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a HTTP/1.1" status: 200 len: 849 time: 0.0486166 Nov 24 16:10:25.992126 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-2c136951-8c81-4a8c-9e8c-9ff17933f0c1 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0308669 Nov 24 16:10:26.086334 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-3ec13326-22a9-468a-bd57-ce1dcc5e21d3 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858696 Nov 24 16:10:26.191074 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a req-1da2bb5b-24f5-453d-afb0-92bf1f0cbdc6 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0964677 Nov 24 16:10:26.298761 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-54312641-6130-4e68-a809-7878e91dfa5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:26.300270 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-54312641-6130-4e68-a809-7878e91dfa5b service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 1096 time: 0.0551386 Nov 24 16:10:26.330024 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 req-b429398c-d86d-4b2f-9518-0e7fe00c77e7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:26.332514 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 req-b429398c-d86d-4b2f-9518-0e7fe00c77e7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 943 time: 0.0668993 Nov 24 16:10:26.387990 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 req-38ec9368-9a90-4f40-8f07-6ae9b5b33028 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452549 Nov 24 16:10:26.408601 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-60bca25f-13f7-4426-af89-9700dfbcb7c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:26.410111 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-60bca25f-13f7-4426-af89-9700dfbcb7c5 service neutron] 10.222.0.71 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 911 time: 0.1016998 Nov 24 16:10:26.453688 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-c7780257-a655-4a85-a38f-4ef317971667 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149 HTTP/1.1" status: 200 len: 217 time: 0.0361161 Nov 24 16:10:26.509575 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-0284c521-5915-4122-8df0-7efbd68ef524 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:26.512415 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-0284c521-5915-4122-8df0-7efbd68ef524 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a HTTP/1.1" status: 200 len: 849 time: 0.0508285 Nov 24 16:10:26.545094 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-5903bf47-2bd6-43e9-b6e3-afaa03c2b3bc service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265119 Nov 24 16:10:26.642099 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-ac45ee33-cd54-42ec-9fa6-2f44be53b1f0 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887098 Nov 24 16:10:26.743342 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-ac3f9221-1804-45b7-b876-29363c54ecf3 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940342 Nov 24 16:10:27.513440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aeccdbf-da11-4f63-81bd-743869ba595a req-aad67883-f60b-4e0e-bd1c-7f564c0b6b8d tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:27.514818 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0aeccdbf-da11-4f63-81bd-743869ba595a req-aad67883-f60b-4e0e-bd1c-7f564c0b6b8d tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 943 time: 0.0500801 Nov 24 16:10:27.561441 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0aeccdbf-da11-4f63-81bd-743869ba595a req-ad196ee4-88ec-481a-ab74-b7d69dfc97ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402668 Nov 24 16:10:28.683910 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2a9044-89de-4b16-95e7-613abde0cd1e req-4bb3fc4b-b991-4bf2-b86b-fc1fa0c535a9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:28.685439 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5b2a9044-89de-4b16-95e7-613abde0cd1e req-4bb3fc4b-b991-4bf2-b86b-fc1fa0c535a9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 943 time: 0.0515730 Nov 24 16:10:28.731800 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5b2a9044-89de-4b16-95e7-613abde0cd1e req-8dcd0c13-f66a-4ba3-9408-1ab8ec1402d5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404925 Nov 24 16:10:29.856668 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0029fb-a912-4d5f-9ef4-19a117edd46f req-aae140fc-6fc6-49cc-98cd-08b423b1f2ac tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:29.858208 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b0029fb-a912-4d5f-9ef4-19a117edd46f req-aae140fc-6fc6-49cc-98cd-08b423b1f2ac tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 943 time: 0.0547290 Nov 24 16:10:29.905561 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b0029fb-a912-4d5f-9ef4-19a117edd46f req-3b0169bc-3c6c-4fd8-a535-0e1117f05965 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408442 Nov 24 16:10:30.148427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:10:30.244770 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:30.256741 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149', 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4', 'port_id': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149', 'mac_address': 'fa:16:3e:55:58:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1006, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3d0fe7c-77a4-4bca-b667-996a7fad1c6a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:10:30.293747 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:30.307427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:10:30.327798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:30.331977 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:30.381094 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:30.796885 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0ef17b69-6b2d-4dcb-8260-0e3639cb1149'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:10:31.024587 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e29455ea-2f96-43ca-a3d8-72912a174c91 req-06ecb901-f556-43d5-8a58-ba97d7d2dd10 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:31.026164 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e29455ea-2f96-43ca-a3d8-72912a174c91 req-06ecb901-f556-43d5-8a58-ba97d7d2dd10 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 944 time: 0.0511122 Nov 24 16:10:31.081823 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e29455ea-2f96-43ca-a3d8-72912a174c91 req-9ed2ccc9-9ccb-4ec6-aa4a-4d31bf06068f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446682 Nov 24 16:10:32.158509 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:10:32.200132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ede1c5-9fd8-46e6-a724-5f223165df34 req-61916c7a-cdd7-48ae-9575-5b392dc760dd tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:32.201692 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-39ede1c5-9fd8-46e6-a724-5f223165df34 req-61916c7a-cdd7-48ae-9575-5b392dc760dd tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 944 time: 0.0514917 Nov 24 16:10:32.209743 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:10:32.214493 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:10:32.214871 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:32.252207 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-39ede1c5-9fd8-46e6-a724-5f223165df34 req-a26bd8d5-b062-4ad7-9502-c96fff4bb878 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434034 Nov 24 16:10:32.292716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:32.315852 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:32.318174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67" -d '{"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-plugged", "status": "completed", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:32.331107 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:32.335028 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:32.362664 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 x-openstack-request-id: req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:32.363198 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-plugged", "status": "completed", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:32.363483 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:32.364002 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149', 'code': 200} Nov 24 16:10:32.390169 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:32.563348 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e90a0b-d04e-4fec-978e-b4a0fd83112e req-9241101f-a5fd-42fa-b4e4-df2e25605c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:32.564823 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f8e90a0b-d04e-4fec-978e-b4a0fd83112e req-9241101f-a5fd-42fa-b4e4-df2e25605c3b service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 1098 time: 0.0823677 Nov 24 16:10:32.618924 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f8e90a0b-d04e-4fec-978e-b4a0fd83112e req-d3cd6070-652f-437b-b456-c5a9a7df12eb service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452614 Nov 24 16:10:33.369202 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 req-a90dd574-c1be-4f99-8cc3-4c94bb268b2c tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:33.370620 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 req-a90dd574-c1be-4f99-8cc3-4c94bb268b2c tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0496817 Nov 24 16:10:33.419312 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 req-841aaa85-f81f-42f5-9044-2243a62fa7c0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417528 Nov 24 16:10:34.549322 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e req-a60c3d4b-dddf-405a-b281-bd39224d8be0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:34.551339 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e req-a60c3d4b-dddf-405a-b281-bd39224d8be0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0556438 Nov 24 16:10:34.617283 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e req-08d79f20-fa7b-40de-bb4a-adf5a97bcfb4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519011 Nov 24 16:10:35.740666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c1c516-540e-4bbc-9553-fcf8c353def4 req-aa064356-f2b6-4dc0-8b71-204b72a7da12 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:35.742156 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-64c1c516-540e-4bbc-9553-fcf8c353def4 req-aa064356-f2b6-4dc0-8b71-204b72a7da12 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0495758 Nov 24 16:10:35.791331 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-64c1c516-540e-4bbc-9553-fcf8c353def4 req-8d272973-4c30-4716-9731-550255eff515 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431857 Nov 24 16:10:36.441266 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea586498-0b8a-4f48-b0ec-707aee282811 req-809fd6f6-80ea-404e-a869-ee553f50b00b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:36.442744 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ea586498-0b8a-4f48-b0ec-707aee282811 req-809fd6f6-80ea-404e-a869-ee553f50b00b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0520065 Nov 24 16:10:36.488799 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ea586498-0b8a-4f48-b0ec-707aee282811 req-a88b82e5-5e6c-4202-9bf5-96130753bf1c tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400848 Nov 24 16:10:37.607880 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2083916d-9d11-49e3-9df3-fa7d6809d612 req-7a9516f0-4017-4c98-8bff-529191498899 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:37.609406 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2083916d-9d11-49e3-9df3-fa7d6809d612 req-7a9516f0-4017-4c98-8bff-529191498899 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0497353 Nov 24 16:10:37.656324 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2083916d-9d11-49e3-9df3-fa7d6809d612 req-2fe6ef33-cf8a-4408-9a9a-cc8f43571f59 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408223 Nov 24 16:10:37.990706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a204eacf-42ee-494b-9280-086ba0286a2b req-e12ab3a4-0112-4936-9596-8aa6bf0bfbcc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:37.992156 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a204eacf-42ee-494b-9280-086ba0286a2b req-e12ab3a4-0112-4936-9596-8aa6bf0bfbcc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 945 time: 0.0491841 Nov 24 16:10:38.085910 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Deleting port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:10:38.086359 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:38.173615 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] For port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:38.173957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:38.185998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling delete_port for 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:10:38.314315 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:38.326390 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0ef17b69-6b2d-4dcb-8260-0e3639cb1149'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:10:38.345717 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Pushing event deleted for resources: {'Port': ['ID=0ef17b69-6b2d-4dcb-8260-0e3639cb1149,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:38.385638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] No DVR routers for this DVR port 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:10:38.388088 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:38.391396 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a204eacf-42ee-494b-9280-086ba0286a2b req-557a02ca-82f4-4399-97f5-e9307ecda8b9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "DELETE /v2.0/ports/0ef17b69-6b2d-4dcb-8260-0e3639cb1149 HTTP/1.1" status: 204 len: 173 time: 0.3929052 Nov 24 16:10:38.391823 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'name': 'network-vif-deleted', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:38.394122 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab" -d '{"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-deleted", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:38.558971 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45884d34-0ac6-45b5-97b1-b45295a24bcb x-openstack-request-id: req-45884d34-0ac6-45b5-97b1-b45295a24bcb {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:38.559273 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-deleted", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:38.559538 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-45884d34-0ac6-45b5-97b1-b45295a24bcb {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:38.559948 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c7fc3d1-a0d1-43e5-8986-d780108ce97b', 'name': 'network-vif-deleted', 'tag': '0ef17b69-6b2d-4dcb-8260-0e3639cb1149', 'status': 'completed', 'code': 200} Nov 24 16:10:39.022554 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c1a53d95-0037-4403-93b8-098b19335242 req-7332bf8f-b240-43c5-85bc-ecd124072ce3 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=9c7fc3d1-a0d1-43e5-8986-d780108ce97b HTTP/1.1" status: 200 len: 210 time: 0.2825146 Nov 24 16:10:40.288911 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-62362f56-77e2-4ab5-a5d1-91bfab035436 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:40.290382 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-62362f56-77e2-4ab5-a5d1-91bfab035436 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 809 time: 0.0989103 Nov 24 16:10:40.304987 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-848d374e-6ed3-40e6-84b8-f34cbc734a90 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/quotas/342ef6b52f7f4b9a87df95d6eaaad436 HTTP/1.1" status: 200 len: 375 time: 0.0090261 Nov 24 16:10:40.340818 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-24f0d376-1a47-41c6-aaa8-7c231bb361fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0303097 Nov 24 16:10:40.475076 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-a38e261e-5d89-49d5-bc5d-cc9171ca1904 service neutron] 10.222.0.72 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267247 Nov 24 16:10:40.565269 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-733c9224-2424-429d-b864-2c0e6bcef594 service neutron] 10.222.0.72 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842125 Nov 24 16:10:40.727375 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-26a01a6d-7bc8-4b20-a9f5-55ca990dbabb req-96d843d2-06ec-4bac-82b6-5bb8a3fab82d tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0304339 Nov 24 16:10:41.821567 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b req-122ce505-44d2-4794-8023-a8f08af80561 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0264118 Nov 24 16:10:42.837606 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:10:42.863789 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:10:42.864140 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0ef17b69-6b2d-4dcb-8260-0e3639cb1149 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:10:42.925014 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-36d68f1e-6326-4657-8999-1555861711e5 req-a256e80a-56cc-4d9f-93ed-888a9d69925e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0280344 Nov 24 16:10:44.019443 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6ffd6719-3738-4658-a545-06d27bf87077 req-6e2f52df-f4e3-4f70-98c0-75d24d5f2532 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0261827 Nov 24 16:10:44.221344 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:44.756494 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-3c266b97-8250-4e3f-a818-32eff0053203 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:44.758053 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-3c266b97-8250-4e3f-a818-32eff0053203 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 809 time: 0.1091435 Nov 24 16:10:44.771558 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Request body: {'port': {'device_id': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4', 'admin_state_up': True, 'tenant_id': '342ef6b52f7f4b9a87df95d6eaaad436'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:44.887135 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Made reservation on behalf of 342ef6b52f7f4b9a87df95d6eaaad436 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:10:44.891825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.016457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Allocated IP 172.20.0.6 (0f425afc-3f71-4bdb-94b6-fb87f034ecf4/a3d0fe7c-77a4-4bca-b667-996a7fad1c6a/df16fe47-5144-47de-bf63-d5685166da50) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:10:45.146520 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ef5df0ae-cfa6-4f95-9251-0110d9801bee req-bbe41d47-e1e1-46a1-9577-883b0a25a7d2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0568171 Nov 24 16:10:45.183688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.440331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.481188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:10:45.486660 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:10:45.490159 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:10:45.518362 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Pushing event updated for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:45.529132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.529488 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.529831 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.530167 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.530499 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.531919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.532266 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.532609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.532946 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.533324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.533650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.533977 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:10:45.554806 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:45.555401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.571656 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-22ef24ae-695b-46ca-b40d-72162368659a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8039744 Nov 24 16:10:45.585334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Request body: {'port': {'device_id': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:10:45.638244 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.887309 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id df16fe47-5144-47de-bf63-d5685166da50 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:10:45.894866 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.907707 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Transition to ACTIVE for port object df16fe47-5144-47de-bf63-d5685166da50 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:10:45.911252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:45.958743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Pushing event updated for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:46.030564 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Attempting to bind port df16fe47-5144-47de-bf63-d5685166da50 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:10:46.031495 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Attempting to bind port df16fe47-5144-47de-bf63-d5685166da50 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:10:46.031824 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Attempting to bind port df16fe47-5144-47de-bf63-d5685166da50 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:10:46.036019 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Port df16fe47-5144-47de-bf63-d5685166da50 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:10:46.036334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Attempting to bind port df16fe47-5144-47de-bf63-d5685166da50 on network 0f425afc-3f71-4bdb-94b6-fb87f034ecf4 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:10:46.041437 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 10, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:10:46.041771 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Checking segment: {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:10:46.042173 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Bound using segment: {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:10:46.042580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Bound port: df16fe47-5144-47de-bf63-d5685166da50, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1006, 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:10:46.042934 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:46.104485 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:10:46.107628 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=df16fe47-5144-47de-bf63-d5685166da50,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:10:46.112352 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:46.145002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.145634 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:46.146984 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] 10.222.0.71 "PUT /v2.0/ports/df16fe47-5144-47de-bf63-d5685166da50 HTTP/1.1" status: 200 len: 1093 time: 0.5656371 Nov 24 16:10:46.147414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:46.149639 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb" -d '{"events": [{"name": "network-changed", "server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:46.175324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2f663e-0006-42c1-adc4-f22c5ee7f582 service neutron] Pushing event updated for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:46.191430 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf781e05-3691-489b-a824-02f347faecfb x-openstack-request-id: req-cf781e05-3691-489b-a824-02f347faecfb {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:46.196003 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "tag": "df16fe47-5144-47de-bf63-d5685166da50", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:46.196267 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-cf781e05-3691-489b-a824-02f347faecfb {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:46.196677 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50', 'status': 'completed', 'code': 200} Nov 24 16:10:46.271029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-de8946da-5f7c-41bf-a4a9-c3ae86a092c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.272496 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-de8946da-5f7c-41bf-a4a9-c3ae86a092c6 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 1096 time: 0.0733211 Nov 24 16:10:46.284477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115f32b6-072d-4492-9c6e-f05da18692c6 req-bb4e5d4a-cfa1-4789-852c-e8cfb4e6a027 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.285859 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-115f32b6-072d-4492-9c6e-f05da18692c6 req-bb4e5d4a-cfa1-4789-852c-e8cfb4e6a027 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 943 time: 0.0575044 Nov 24 16:10:46.324082 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-4ca2e0d3-5749-4b80-ac1d-c7c6c2d108d3 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=df16fe47-5144-47de-bf63-d5685166da50 HTTP/1.1" status: 200 len: 217 time: 0.0372903 Nov 24 16:10:46.396863 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-115f32b6-072d-4492-9c6e-f05da18692c6 req-9622f313-7787-4a2b-946e-c0b58408073a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046324 Nov 24 16:10:46.398272 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-63548d77-da8c-4464-8efe-1a7cfa01016f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.399704 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-63548d77-da8c-4464-8efe-1a7cfa01016f service neutron] 10.222.0.71 "GET /v2.0/subnets?id=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a HTTP/1.1" status: 200 len: 849 time: 0.0690517 Nov 24 16:10:46.433941 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-f1bea57f-2411-41e4-b142-96db0deac2ae service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262668 Nov 24 16:10:46.521999 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-5326b1b7-4b2c-480e-945c-ae2e0583f5f2 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810347 Nov 24 16:10:46.618481 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 req-52421373-8921-40fb-9ee8-fa778eaf60b1 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888753 Nov 24 16:10:46.710955 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-e8ca1a87-e6b9-4cf5-8c71-d36152e291bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.712722 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-e8ca1a87-e6b9-4cf5-8c71-d36152e291bd service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 1096 time: 0.0436509 Nov 24 16:10:46.808705 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-0fcea447-4e73-4be9-80dd-0014fc1cbbd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.810190 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-0fcea447-4e73-4be9-80dd-0014fc1cbbd7 service neutron] 10.222.0.71 "GET /v2.0/networks?id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 200 len: 911 time: 0.0904217 Nov 24 16:10:46.857479 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-5b081ebb-77b6-472e-a54f-345ee7b186f8 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=df16fe47-5144-47de-bf63-d5685166da50 HTTP/1.1" status: 200 len: 217 time: 0.0389183 Nov 24 16:10:46.911408 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-361291fb-48f0-4fe8-9f98-ca932142e791 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:46.912839 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-361291fb-48f0-4fe8-9f98-ca932142e791 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a HTTP/1.1" status: 200 len: 849 time: 0.0473654 Nov 24 16:10:46.945890 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-e5ec1ddd-d03f-400a-8efa-8f72cc00a564 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=0f425afc-3f71-4bdb-94b6-fb87f034ecf4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0254993 Nov 24 16:10:47.033802 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-7b900092-7b5f-4361-b09a-78fe69bf39d0 service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0804126 Nov 24 16:10:47.127816 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-a1727363-6f2a-4cbe-ab96-4d447c354e1b service neutron] 10.222.0.71 "GET /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866237 Nov 24 16:10:47.515018 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4723721-b832-4aa3-a5b3-4435f8c262a0 req-31c7b8db-228d-4c35-ac68-e53c0cf67e54 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:47.516744 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a4723721-b832-4aa3-a5b3-4435f8c262a0 req-31c7b8db-228d-4c35-ac68-e53c0cf67e54 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 943 time: 0.0489490 Nov 24 16:10:47.563403 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a4723721-b832-4aa3-a5b3-4435f8c262a0 req-a8c692b5-cf3b-4b65-9d27-c55c42b6bd08 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407677 Nov 24 16:10:48.610375 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b245c215-8ba7-4a37-b3c7-9eafd9651099 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:48.682358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824348db-d93d-4281-a452-ced42bfef80f req-c2eb43d9-9b69-48c6-94e3-6cae6f54f034 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:48.683841 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-824348db-d93d-4281-a452-ced42bfef80f req-c2eb43d9-9b69-48c6-94e3-6cae6f54f034 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 943 time: 0.0498960 Nov 24 16:10:48.734389 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-824348db-d93d-4281-a452-ced42bfef80f req-ced263e5-b2f2-4934-8172-9325835062c9 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439210 Nov 24 16:10:49.858407 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447255ce-35cc-41db-9e1c-274689cd9cc2 req-70eb9333-478f-40e9-91d6-416ef67d0bb6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:49.860183 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-447255ce-35cc-41db-9e1c-274689cd9cc2 req-70eb9333-478f-40e9-91d6-416ef67d0bb6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 943 time: 0.0541267 Nov 24 16:10:49.910802 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-447255ce-35cc-41db-9e1c-274689cd9cc2 req-d45f7b8b-17d2-4193-b4d1-e2c8c7e3cff4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441508 Nov 24 16:10:50.037508 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37764) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:50.139504 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e21c505-fed6-4ad2-afa4-af3f0ad22f93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.213642 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e21c505-fed6-4ad2-afa4-af3f0ad22f93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.216941 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9e21c505-fed6-4ad2-afa4-af3f0ad22f93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.221821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device df16fe47-5144-47de-bf63-d5685166da50 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:10:50.255798 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e21c505-fed6-4ad2-afa4-af3f0ad22f93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f06a33a2-f134-4b35-8330-60242d4fbb6d,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:50.260158 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9e21c505-fed6-4ad2-afa4-af3f0ad22f93 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=361de31902f446368d69a5b5d409bdec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2216291 Nov 24 16:10:50.262815 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 37768) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:10:50.311190 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.320227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=df16fe47-5144-47de-bf63-d5685166da50,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:50.331704 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'df16fe47-5144-47de-bf63-d5685166da50', 'network_id': '0f425afc-3f71-4bdb-94b6-fb87f034ecf4', 'port_id': 'df16fe47-5144-47de-bf63-d5685166da50', 'mac_address': 'fa:16:3e:af:98:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1006, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3d0fe7c-77a4-4bca-b667-996a7fad1c6a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:10:50.334113 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.369184 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.382314 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id df16fe47-5144-47de-bf63-d5685166da50 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:10:50.387016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.390923 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.392106 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f06a33a2-f134-4b35-8330-60242d4fbb6d HTTP/1.1" status: 204 len: 168 time: 0.1283314 Nov 24 16:10:50.400496 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995fdfa0-a62c-4eda-8c4d-0e156bd73855 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f06a33a2-f134-4b35-8330-60242d4fbb6d,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:50.403085 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=df16fe47-5144-47de-bf63-d5685166da50,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:50.408576 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:50.471367 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:50.750523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['df16fe47-5144-47de-bf63-d5685166da50'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:10:51.001820 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:10:51.037221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc req-14468f48-5a80-4e74-b222-631bd80edd43 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:51.038705 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc req-14468f48-5a80-4e74-b222-631bd80edd43 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 944 time: 0.0580268 Nov 24 16:10:51.086047 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc req-5edb3d56-fb77-42c7-ae21-e4ee9302dea7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414782 Nov 24 16:10:51.259767 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-30fe4858-e984-428a-9062-d1555e290239 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:52.200353 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faeea81d-96c3-4ac8-b619-7327153ac0ba req-1c0d7437-b173-4e3a-b9b3-c546bb6c9504 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:52.201833 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-faeea81d-96c3-4ac8-b619-7327153ac0ba req-1c0d7437-b173-4e3a-b9b3-c546bb6c9504 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 944 time: 0.0488369 Nov 24 16:10:52.233459 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device df16fe47-5144-47de-bf63-d5685166da50 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:10:52.251521 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-faeea81d-96c3-4ac8-b619-7327153ac0ba req-0673a513-fa4f-407b-a9c8-760947e2f69a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424538 Nov 24 16:10:52.282723 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port df16fe47-5144-47de-bf63-d5685166da50 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:10:52.286819 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port df16fe47-5144-47de-bf63-d5685166da50 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:10:52.287177 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:52.364454 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:52.387434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:52.389705 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41075840-ed8e-4c96-a61e-fdcc62a863d5" -d '{"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-plugged", "status": "completed", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:52.406152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=df16fe47-5144-47de-bf63-d5685166da50,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:52.410741 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:52.435362 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 x-openstack-request-id: req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:52.435666 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-plugged", "status": "completed", "tag": "df16fe47-5144-47de-bf63-d5685166da50", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:52.435922 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:52.436308 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50', 'code': 200} Nov 24 16:10:52.462557 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:52.597613 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28a27fb-0715-4311-815b-df8d70143e37 req-505e9ce5-b55f-411f-b8a9-cf6869498d86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:52.599133 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f28a27fb-0715-4311-815b-df8d70143e37 req-505e9ce5-b55f-411f-b8a9-cf6869498d86 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 1098 time: 0.0401030 Nov 24 16:10:52.636728 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:52.645740 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f28a27fb-0715-4311-815b-df8d70143e37 req-cb6cde53-96b2-43af-8bb5-63e50074aab6 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391748 Nov 24 16:10:53.369055 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3394ca26-0889-4dee-a406-21556596dbe5 req-6be8925d-b12a-404d-9351-6a79353a0395 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:53.370547 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3394ca26-0889-4dee-a406-21556596dbe5 req-6be8925d-b12a-404d-9351-6a79353a0395 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 945 time: 0.0490091 Nov 24 16:10:53.417578 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3394ca26-0889-4dee-a406-21556596dbe5 req-812041e3-0100-451d-bd97-52b56d298c59 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404267 Nov 24 16:10:54.315823 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:54.462384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:54.544581 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 req-82ade1d4-6278-4b77-9bfc-d2dee6927da0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:54.546735 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 req-82ade1d4-6278-4b77-9bfc-d2dee6927da0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 945 time: 0.0582952 Nov 24 16:10:54.597580 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 req-e61d22ac-271c-4780-a298-496c5b593148 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448127 Nov 24 16:10:55.246083 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb req-289a3ad1-7afd-434b-a525-2cd54880b129 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:55.247562 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb req-289a3ad1-7afd-434b-a525-2cd54880b129 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 945 time: 0.0554202 Nov 24 16:10:55.294958 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb req-44dea6a9-e8a7-4ddb-a180-af364a53acf1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405602 Nov 24 16:10:56.415071 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 req-2bfb5e88-3539-4df1-861e-fad6e179d1c8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:56.416544 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 req-2bfb5e88-3539-4df1-861e-fad6e179d1c8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 945 time: 0.0524299 Nov 24 16:10:56.464748 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 req-d4d28345-3883-45ff-9dbf-6f8c4b74eab2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/security-groups?id=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414701 Nov 24 16:10:56.823585 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-996da2e5-9d79-45a2-9fe3-47071fc68890 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:10:56.825021 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-996da2e5-9d79-45a2-9fe3-47071fc68890 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 945 time: 0.0484281 Nov 24 16:10:56.918760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Deleting port df16fe47-5144-47de-bf63-d5685166da50 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:10:56.919090 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:57.003699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] For port df16fe47-5144-47de-bf63-d5685166da50, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=df16fe47-5144-47de-bf63-d5685166da50,segment=NetworkSegment(a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c),segment_id=a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:10:57.004045 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:57.016734 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling delete_port for df16fe47-5144-47de-bf63-d5685166da50 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:10:57.142939 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:57.154808 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['df16fe47-5144-47de-bf63-d5685166da50'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:10:57.171651 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Pushing event deleted for resources: {'Port': ['ID=df16fe47-5144-47de-bf63-d5685166da50,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:10:57.222785 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] No DVR routers for this DVR port df16fe47-5144-47de-bf63-d5685166da50 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:10:57.225316 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:10:57.228614 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 req-174a5e50-d867-4c92-bee8-0d30c688ba35 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.71 "DELETE /v2.0/ports/df16fe47-5144-47de-bf63-d5685166da50 HTTP/1.1" status: 204 len: 173 time: 0.3960743 Nov 24 16:10:57.229083 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'name': 'network-vif-deleted', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:10:57.231317 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f33889c7-225e-4304-a414-49e298417dad" -d '{"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-deleted", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:10:57.270519 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:10:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d x-openstack-request-id: req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:10:57.270805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-deleted", "tag": "df16fe47-5144-47de-bf63-d5685166da50", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:10:57.271068 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:10:57.271484 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ab293fa-b007-4902-940e-04f5bb4f953b', 'name': 'network-vif-deleted', 'tag': 'df16fe47-5144-47de-bf63-d5685166da50', 'status': 'completed', 'code': 200} Nov 24 16:10:57.578862 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc req-1d24ffa5-a714-4549-98fd-a38fac80a6c4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /v2.0/ports?device_id=4ab293fa-b007-4902-940e-04f5bb4f953b HTTP/1.1" status: 200 len: 210 time: 0.0288248 Nov 24 16:11:02.239460 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device df16fe47-5144-47de-bf63-d5685166da50 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:11:02.259534 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: df16fe47-5144-47de-bf63-d5685166da50 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:11:02.259882 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device df16fe47-5144-47de-bf63-d5685166da50 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:11:08.488200 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c6c8f9-922c-490c-9c08-a98b33477b6c req-61ba8226-1a96-4060-b1eb-a47687de3f23 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:08.490553 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-48c6c8f9-922c-490c-9c08-a98b33477b6c req-61ba8226-1a96-4060-b1eb-a47687de3f23 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0733943 Nov 24 16:11:08.556566 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-48c6c8f9-922c-490c-9c08-a98b33477b6c req-1f7f16c6-d495-4f16-9cda-f8357e936054 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517259 Nov 24 16:11:09.704838 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab3fb52-a0f1-4525-a0db-51123ad1740c req-45cb147e-d8ac-4f26-9a44-b13e40d08643 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:09.710656 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-aab3fb52-a0f1-4525-a0db-51123ad1740c req-45cb147e-d8ac-4f26-9a44-b13e40d08643 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0669537 Nov 24 16:11:09.759639 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-aab3fb52-a0f1-4525-a0db-51123ad1740c req-ec29c284-7a2c-4e37-8c3c-8703229510de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466690 Nov 24 16:11:10.915126 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8309b320-a4d3-4a7d-a28a-e15049d3067d req-ae50388d-35bd-47c8-92bb-35d3339a52c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:10.916834 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8309b320-a4d3-4a7d-a28a-e15049d3067d req-ae50388d-35bd-47c8-92bb-35d3339a52c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0629249 Nov 24 16:11:10.973342 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8309b320-a4d3-4a7d-a28a-e15049d3067d req-19965696-ef2e-4f19-8c63-9716f7b74f3a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478525 Nov 24 16:11:12.098932 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 req-f016b21e-6a9f-45c5-8ee9-50335dc8d6a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:12.100427 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 req-f016b21e-6a9f-45c5-8ee9-50335dc8d6a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0521886 Nov 24 16:11:12.154923 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 req-35782ed2-8b45-4942-9b9e-fd837a2073e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478966 Nov 24 16:11:13.290719 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694e121d-dc93-418a-9aca-a3e1829d381d req-06cc3d6b-de59-4429-88f4-26f7b4f495f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:13.292272 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-694e121d-dc93-418a-9aca-a3e1829d381d req-06cc3d6b-de59-4429-88f4-26f7b4f495f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0553839 Nov 24 16:11:13.361492 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-694e121d-dc93-418a-9aca-a3e1829d381d req-ae663aab-b839-455f-a55e-e1dc7a2b6d06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584319 Nov 24 16:11:14.240311 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:14.491465 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 req-e44185ac-a7ba-49a0-b428-a0d4e3b9922f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:14.493833 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 req-e44185ac-a7ba-49a0-b428-a0d4e3b9922f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0580890 Nov 24 16:11:14.551221 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 req-f8826e5f-50ef-401f-96b8-4cfeb917bee6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477037 Nov 24 16:11:15.700836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d req-44010bb1-207c-49dc-8cfb-e2bc20e1d036 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:15.703039 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d req-44010bb1-207c-49dc-8cfb-e2bc20e1d036 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0644813 Nov 24 16:11:15.774036 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d req-16036eec-7909-4877-940e-2809e2325cea tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0626769 Nov 24 16:11:16.921562 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e18a79-4f95-40a5-af63-3d048087b79a req-4f290079-32d1-47cd-9228-36ce939833d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:16.923921 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e18a79-4f95-40a5-af63-3d048087b79a req-4f290079-32d1-47cd-9228-36ce939833d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0565679 Nov 24 16:11:16.979078 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-18e18a79-4f95-40a5-af63-3d048087b79a req-caed39fe-9de1-4ef8-a4c2-16cc3eb79788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490921 Nov 24 16:11:17.551017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-e55bceb3-f5ba-437e-a19b-7997a321ddf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:17.552865 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-e55bceb3-f5ba-437e-a19b-7997a321ddf3 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1098 time: 0.0477591 Nov 24 16:11:17.680004 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-eb2d4255-266d-4156-a3b7-399506dd438b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:17.682080 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-eb2d4255-266d-4156-a3b7-399506dd438b service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.1061428 Nov 24 16:11:17.763766 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-c665afd7-02b8-4bb5-8de8-1d65977f5976 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 1001 time: 0.0742495 Nov 24 16:11:17.819916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-c0951957-ab3d-4ffe-b5b2-6df24040d9cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:17.821376 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-c0951957-ab3d-4ffe-b5b2-6df24040d9cf service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0472140 Nov 24 16:11:17.872037 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-80362113-9914-4dc0-97e3-8722507fdff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:17.874148 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-80362113-9914-4dc0-97e3-8722507fdff1 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442066 Nov 24 16:11:17.980886 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-74deba8d-6a2d-4214-b9f6-2b1538fa4e94 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990655 Nov 24 16:11:18.077609 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a2bdc0b8-2c0d-4106-9094-b72aa8ce146b req-76edd993-27ac-417a-88af-4d7407187040 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886037 Nov 24 16:11:18.116467 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f req-7494eeb0-7c2b-48bb-b215-7f4232bce571 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:18.118137 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f req-7494eeb0-7c2b-48bb-b215-7f4232bce571 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0566850 Nov 24 16:11:18.181490 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f req-50cd8222-20f9-401b-a0f2-f5a3131c08ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561135 Nov 24 16:11:18.616857 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-356da993-dee7-430a-88e6-26803d790143 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:19.304996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 req-4bf168e9-2820-4cb2-aff5-8ba9e8b7b903 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:19.306649 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 req-4bf168e9-2820-4cb2-aff5-8ba9e8b7b903 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0510948 Nov 24 16:11:19.371623 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 req-64d2011e-33b5-402c-a196-3dc03a9972e2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0567279 Nov 24 16:11:20.071248 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-e3300ea2-7ba8-406c-a2fb-c594411e9de4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.072661 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-e3300ea2-7ba8-406c-a2fb-c594411e9de4 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1138 time: 0.1052005 Nov 24 16:11:20.093315 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a1291e-2340-4e9d-a88d-409edc707ed0 req-03f62c81-0b6b-4bb5-ac2e-9b80e85bb09b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.095679 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85a1291e-2340-4e9d-a88d-409edc707ed0 req-03f62c81-0b6b-4bb5-ac2e-9b80e85bb09b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0914874 Nov 24 16:11:20.225990 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85a1291e-2340-4e9d-a88d-409edc707ed0 req-994c33ac-507f-4d10-b4dc-66d7def7fd68 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1208570 Nov 24 16:11:20.244442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-06d60a69-c6fa-45d5-9d47-0921dea10b7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.246222 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-06d60a69-c6fa-45d5-9d47-0921dea10b7e service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.1493526 Nov 24 16:11:20.338572 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-3d0806c8-df84-4c7c-a6cb-1a3099b180b9 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 1001 time: 0.0793829 Nov 24 16:11:20.395104 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-a19e28b1-a767-4ae3-96ec-c9a945f8c8d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.396725 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-a19e28b1-a767-4ae3-96ec-c9a945f8c8d3 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0506589 Nov 24 16:11:20.476331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-c9689ed4-553c-45b4-b8df-5f10f7a629a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.478264 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-c9689ed4-553c-45b4-b8df-5f10f7a629a6 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0682240 Nov 24 16:11:20.526208 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 req-1e9c07e1-2f87-4783-9ffe-17f57595c79f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:20.527836 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 req-1e9c07e1-2f87-4783-9ffe-17f57595c79f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0605254 Nov 24 16:11:20.588062 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 req-2d810151-1cce-452d-8637-d9414c34c2f8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0532846 Nov 24 16:11:20.594806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-b6b5a1a9-75fb-4656-b72b-f29da293bb2a service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077127 Nov 24 16:11:20.717113 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-132ec1e4-4145-4608-8a51-7d07f98bc9ed req-fa4c8589-03e4-46cc-a556-092598c25c32 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1136873 Nov 24 16:11:21.263813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-98f53ce5-303b-4907-a10f-e310acbcf3ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:21.371899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 req-2aea96d8-5133-4a2f-b8ef-b500e37ddfb8 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:21.373559 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 req-2aea96d8-5133-4a2f-b8ef-b500e37ddfb8 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0530186 Nov 24 16:11:21.467410 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 req-6c99dc89-e15d-48da-8cde-a2c1ebbcb8f1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0863640 Nov 24 16:11:21.775327 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e48eb6b-c171-4252-8d99-486f4bdc486c req-67246e54-dc15-444d-ac11-0b9feebde33a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:21.776847 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e48eb6b-c171-4252-8d99-486f4bdc486c req-67246e54-dc15-444d-ac11-0b9feebde33a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0570574 Nov 24 16:11:21.831072 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e48eb6b-c171-4252-8d99-486f4bdc486c req-d2834807-28b3-44e9-95d5-1774e7ac3714 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469623 Nov 24 16:11:22.588736 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f259df0-eaea-4e56-b7e3-2e38932b3aab req-eb99fafd-7217-494c-9bda-9cc907476bfa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:22.591057 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1f259df0-eaea-4e56-b7e3-2e38932b3aab req-eb99fafd-7217-494c-9bda-9cc907476bfa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0526671 Nov 24 16:11:22.653016 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:22.664213 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1f259df0-eaea-4e56-b7e3-2e38932b3aab req-a78c0ee0-b155-4b6e-ac6b-1603dc643662 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0662251 Nov 24 16:11:22.956945 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ad93ed-6153-463b-a234-9a5b588f4974 req-544739c9-7adf-4780-9dad-2f970d62c020 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:22.958506 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-36ad93ed-6153-463b-a234-9a5b588f4974 req-544739c9-7adf-4780-9dad-2f970d62c020 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0512440 Nov 24 16:11:23.010158 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-36ad93ed-6153-463b-a234-9a5b588f4974 req-b663fa3b-83b2-473d-b9c5-6abb3c8027e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455260 Nov 24 16:11:23.786318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f39faba-caec-453f-950a-300f6a323156 req-077b94b0-ec01-4e81-aecf-61a4f6a00472 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:23.787825 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f39faba-caec-453f-950a-300f6a323156 req-077b94b0-ec01-4e81-aecf-61a4f6a00472 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0517004 Nov 24 16:11:23.848733 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f39faba-caec-453f-950a-300f6a323156 req-c7a1d4d3-0409-4225-869e-7c362d3c4f3c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0548353 Nov 24 16:11:24.137284 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83dd365d-b04d-4681-8408-a734561ef7ad req-89d3cae2-f8ba-4d21-a23d-50e5892b19a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.138891 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-83dd365d-b04d-4681-8408-a734561ef7ad req-89d3cae2-f8ba-4d21-a23d-50e5892b19a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0566287 Nov 24 16:11:24.195496 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-83dd365d-b04d-4681-8408-a734561ef7ad req-c2b19e44-05fb-4b1a-a448-66fa280b6fad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504827 Nov 24 16:11:24.333061 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:24.442312 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e6a14a-0297-4e20-b905-fbe6817221ba req-02bc3925-5a0c-44fc-a751-0b01f76b91f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.446008 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-20e6a14a-0297-4e20-b905-fbe6817221ba req-02bc3925-5a0c-44fc-a751-0b01f76b91f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0560582 Nov 24 16:11:24.465659 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:24.495223 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-094bbaba-bf26-470b-a12a-6e9ac6604965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.497835 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-094bbaba-bf26-470b-a12a-6e9ac6604965 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 1098 time: 0.0618162 Nov 24 16:11:24.511924 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-20e6a14a-0297-4e20-b905-fbe6817221ba req-6bd6bd4d-d46e-440b-8452-a1e6c80f1812 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619981 Nov 24 16:11:24.608780 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-ffb1d02e-7883-4d12-9ec0-45cf3767828e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.611128 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-ffb1d02e-7883-4d12-9ec0-45cf3767828e service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.0931976 Nov 24 16:11:24.686394 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-0d468128-a76e-49e9-8139-d018d5dd52b5 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 200 len: 1001 time: 0.0664792 Nov 24 16:11:24.738103 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-4002a581-e93f-4587-a82f-12d68bfbcb92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.739463 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-4002a581-e93f-4587-a82f-12d68bfbcb92 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0455799 Nov 24 16:11:24.788540 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-54499c9d-85c1-448e-badf-83f42e4a6731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:24.790101 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-54499c9d-85c1-448e-badf-83f42e4a6731 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0425045 Nov 24 16:11:24.890225 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-0c934ce2-2925-429f-9289-b4795c769913 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920846 Nov 24 16:11:25.017219 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d4eac3-7a2c-4669-b056-98900fcdd803 req-5181c350-a1cd-43de-8e7f-899a813fbd9d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:25.018622 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-99d4eac3-7a2c-4669-b056-98900fcdd803 req-5181c350-a1cd-43de-8e7f-899a813fbd9d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0999265 Nov 24 16:11:25.024152 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 req-e97d2389-967c-4ebe-ae51-5310c06dcd5c service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258011 Nov 24 16:11:25.079394 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-99d4eac3-7a2c-4669-b056-98900fcdd803 req-b95524d0-9872-47c2-86d2-0b2490973500 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0542657 Nov 24 16:11:25.619814 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38134) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:25.654665 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1434c1a7-7beb-4628-b75c-7e580f6bd101 req-8f049ef3-5ab4-4bfb-afef-aa6b56f1a847 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:25.656278 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1434c1a7-7beb-4628-b75c-7e580f6bd101 req-8f049ef3-5ab4-4bfb-afef-aa6b56f1a847 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0518863 Nov 24 16:11:25.666935 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Deleting subnet a3d0fe7c-77a4-4bca-b667-996a7fad1c6a {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:11:25.670146 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:25.706886 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30444690'] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:25.710554 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1434c1a7-7beb-4628-b75c-7e580f6bd101 req-22864ef8-e28c-4763-a009-f684065a3c8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479093 Nov 24 16:11:25.756699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:25.808800 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29518436', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29486226'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:25.832651 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a3d0fe7c-77a4-4bca-b667-996a7fad1c6a,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:25.839435 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:25.842687 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-cc7af81b-194f-4f24-b1b5-9c74bbd7a26a admin admin] 10.222.0.72 "DELETE /v2.0/subnets/a3d0fe7c-77a4-4bca-b667-996a7fad1c6a HTTP/1.1" status: 204 len: 168 time: 0.2217510 Nov 24 16:11:25.846234 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38140) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:25.916229 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.001875 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.026312 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0f425afc-3f71-4bdb-94b6-fb87f034ecf4']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:26.037667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:26.037962 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a49b4af3-ef29-4339-b0e1-1a9ce1e85e4c') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:26.049176 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.063715 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.070091 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Releasing vlan 1006 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:11:26.070495 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:11:26.072540 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:11:26.369690 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.375362 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.378627 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] 10.222.0.72 "DELETE /v2.0/networks/0f425afc-3f71-4bdb-94b6-fb87f034ecf4 HTTP/1.1" status: 204 len: 168 time: 0.5314150 Nov 24 16:11:26.397373 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46aafdc6-81d6-479e-a3fe-977df8bc67df admin admin] Pushing event deleted for resources: {'Network': ['ID=0f425afc-3f71-4bdb-94b6-fb87f034ecf4,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:26.418835 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa48c540-021b-43c6-b2cc-69f14fd78471 req-8adf0d34-4e58-4014-919e-1c9d12d70443 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:26.420353 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa48c540-021b-43c6-b2cc-69f14fd78471 req-8adf0d34-4e58-4014-919e-1c9d12d70443 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0837803 Nov 24 16:11:26.491997 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa48c540-021b-43c6-b2cc-69f14fd78471 req-bce59f0a-656f-475a-8321-bcbb65feb519 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0644517 Nov 24 16:11:26.558718 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38146) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:26.601995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-7d68fc91-ac58-44ec-87b5-8879efd6f33c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=342ef6b52f7f4b9a87df95d6eaaad436&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0420840 Nov 24 16:11:26.604399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38148) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:26.656788 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.681548 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.732916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.736022 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:26.737410 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd HTTP/1.1" status: 204 len: 168 time: 0.1319647 Nov 24 16:11:26.745442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84675306-c2ee-4681-bf80-555812518952 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64ce6f4c-6d69-4b62-96ce-d4cb1141a8bd,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:27.623015 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 req-3275d9a5-966a-4e6d-a255-d93b5d0602fa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:27.625457 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 req-3275d9a5-966a-4e6d-a255-d93b5d0602fa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0583425 Nov 24 16:11:27.693465 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 req-5eb4ec4c-b9b8-4ab2-826f-157ace8fa7f1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0594699 Nov 24 16:11:28.002675 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:11:28.816582 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a7de45-7444-4d6a-b83c-c7e00114acdb req-e08a9319-ea53-429a-b689-c40779f0ae63 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:28.818170 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-73a7de45-7444-4d6a-b83c-c7e00114acdb req-e08a9319-ea53-429a-b689-c40779f0ae63 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0494835 Nov 24 16:11:28.879532 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-73a7de45-7444-4d6a-b83c-c7e00114acdb req-3304a0f6-d676-4d60-a911-375618320600 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0553050 Nov 24 16:11:30.001388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f req-506442f5-1a3f-4b9d-bbd6-095a4f7517e3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:30.002910 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f req-506442f5-1a3f-4b9d-bbd6-095a4f7517e3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0506587 Nov 24 16:11:30.064792 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f req-c5cc0f86-ef8c-40b8-a047-a32e875cf829 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0556161 Nov 24 16:11:31.185286 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 req-e46cdbb8-93c1-4455-abbf-627b7c49ca86 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:31.186833 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 req-e46cdbb8-93c1-4455-abbf-627b7c49ca86 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0550132 Nov 24 16:11:31.249056 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 req-1c79a3b5-6cea-4850-9bff-c6dc6d69549a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0557849 Nov 24 16:11:32.371181 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbe78eb-6b93-4f6f-bea1-df02514e90fb req-b403a2cb-db71-4d31-8d9f-322e6460ab8b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:32.372705 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-adbe78eb-6b93-4f6f-bea1-df02514e90fb req-b403a2cb-db71-4d31-8d9f-322e6460ab8b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0527959 Nov 24 16:11:32.435245 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-adbe78eb-6b93-4f6f-bea1-df02514e90fb req-3d83a5c4-21f5-4e6b-8d43-053da1280a4f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0557559 Nov 24 16:11:33.552477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32051222-7816-41d6-a201-51bde635843b req-836b1fbf-0399-49c6-a8c5-a46e0df55153 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:33.554006 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-32051222-7816-41d6-a201-51bde635843b req-836b1fbf-0399-49c6-a8c5-a46e0df55153 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0511086 Nov 24 16:11:33.618390 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-32051222-7816-41d6-a201-51bde635843b req-72becca4-ec32-4719-9691-a79213246afb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0582316 Nov 24 16:11:34.738497 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1019f81-0e65-4853-a181-5ad646fe4e90 req-030772b9-27a1-4908-b30a-2a020bfa035d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:34.739992 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1019f81-0e65-4853-a181-5ad646fe4e90 req-030772b9-27a1-4908-b30a-2a020bfa035d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0495546 Nov 24 16:11:34.801100 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1019f81-0e65-4853-a181-5ad646fe4e90 req-79996fe0-ec09-4c1f-8a5e-e300d62167d6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0548599 Nov 24 16:11:35.917006 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745b1415-0705-4389-b128-dcbe9e642f0d req-4536bc60-5d29-4c72-a853-c06304f93f8a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:35.918507 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-745b1415-0705-4389-b128-dcbe9e642f0d req-4536bc60-5d29-4c72-a853-c06304f93f8a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0488827 Nov 24 16:11:35.978798 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-745b1415-0705-4389-b128-dcbe9e642f0d req-27b91a33-54ea-4703-80ad-c6983a692c1b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0529151 Nov 24 16:11:36.634938 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38298) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:36.751138 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa3cdcde-597d-4fc9-892a-8bacbc04ca52 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:36.848752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa3cdcde-597d-4fc9-892a-8bacbc04ca52 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:36.852924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-aa3cdcde-597d-4fc9-892a-8bacbc04ca52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:36.893102 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-aa3cdcde-597d-4fc9-892a-8bacbc04ca52 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e323f2ead958411d8f41afe14fbac5eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2569315 Nov 24 16:11:36.894183 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3cdcde-597d-4fc9-892a-8bacbc04ca52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b8a47ee-1f58-4b87-afe5-6cf385096634,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:36.896462 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38304) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:36.964033 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:36.991707 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:37.045714 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:37.048997 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:37.050426 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/1b8a47ee-1f58-4b87-afe5-6cf385096634 HTTP/1.1" status: 204 len: 168 time: 0.1526837 Nov 24 16:11:37.092877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b8a47ee-1f58-4b87-afe5-6cf385096634,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:37.105312 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.106350 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.106696 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.107039 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.107379 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.107719 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.108055 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.108912 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.109514 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.109920 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.110346 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.110674 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08c8c74a-60cc-4556-af27-eacc5ac2a0b7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:37.145562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1374d560-968c-45f4-9d88-744a1eb15207 req-bcf97c7b-eb99-41df-b642-896ded269426 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:37.147723 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1374d560-968c-45f4-9d88-744a1eb15207 req-bcf97c7b-eb99-41df-b642-896ded269426 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0935619 Nov 24 16:11:37.229673 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1374d560-968c-45f4-9d88-744a1eb15207 req-6d51b0c3-646b-4d82-8ead-ea766ad4722f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&id=497983bf-eca9-465b-ad1a-9718733e64c7&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0754871 Nov 24 16:11:44.229163 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:46.198350 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 req-b9a5d0b8-b372-4a37-acb8-ee0492f07143 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:46.199821 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 req-b9a5d0b8-b372-4a37-acb8-ee0492f07143 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0502784 Nov 24 16:11:46.252802 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 req-01807d5b-6db7-4abc-9a30-4986eb25c110 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462530 Nov 24 16:11:47.247144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38406) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:47.354096 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-80766b5c-d5e2-499a-8d17-2e442e8f713d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.381507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 req-1e03e7ae-86bb-4c1d-a325-b7bc7f415ce6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:47.382953 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 req-1e03e7ae-86bb-4c1d-a325-b7bc7f415ce6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0536165 Nov 24 16:11:47.434562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-80766b5c-d5e2-499a-8d17-2e442e8f713d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.437606 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 req-88625ddd-cc9a-4461-9c3c-bbe5a2e73903 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483665 Nov 24 16:11:47.438901 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-80766b5c-d5e2-499a-8d17-2e442e8f713d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.477746 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-80766b5c-d5e2-499a-8d17-2e442e8f713d admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=dd93640e5af345b79a98600ee66a484b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2294922 Nov 24 16:11:47.478713 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80766b5c-d5e2-499a-8d17-2e442e8f713d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7a702f3-ede3-465d-ab84-1aadda6e2055,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:47.480427 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38412) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:47.530365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.550728 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.600783 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.603353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:47.604485 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f7a702f3-ede3-465d-ab84-1aadda6e2055 HTTP/1.1" status: 204 len: 168 time: 0.1230426 Nov 24 16:11:47.612381 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7a702f3-ede3-465d-ab84-1aadda6e2055,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:47.619278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.619632 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.619972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.620303 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.620636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.620963 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.621311 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.621638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.622024 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.622266 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.622586 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:47.622905 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a76e83-4f22-47af-a74b-63d883153b46 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:11:48.098628 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-15ba452b-9950-4a47-a094-0bb87f1cee28 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:48.100089 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-15ba452b-9950-4a47-a094-0bb87f1cee28 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0472081 Nov 24 16:11:48.189837 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Deleting port 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:11:48.190175 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.281201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] For port 0cc6f513-6305-463b-bb1d-17ec8928f67c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0cc6f513-6305-463b-bb1d-17ec8928f67c,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:11:48.281563 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.553917 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 req-98bca723-aac3-4666-a32a-f38c09ea0ac2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:48.555437 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 req-98bca723-aac3-4666-a32a-f38c09ea0ac2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 HTTP/1.1" status: 200 len: 946 time: 0.0492792 Nov 24 16:11:48.559700 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.560232 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.560374 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Floating IP d3f1f528-0574-41d3-824e-682325c3b706 disassociated. External IP: 172.27.0.121, port: 0cc6f513-6305-463b-bb1d-17ec8928f67c. Nov 24 16:11:48.560699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling delete_port for 0cc6f513-6305-463b-bb1d-17ec8928f67c owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:11:48.607137 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 req-7cddf91c-de0c-4229-be71-13bd30bf7f43 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=4aeec843-cb50-445f-8ffc-28ad4505fe5b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433712 Nov 24 16:11:48.615292 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2b8ea355-56a5-4421-a15b-6db8984a65dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.691007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.718693 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'Port': ['ID=0cc6f513-6305-463b-bb1d-17ec8928f67c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:48.830002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:11:48.938212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:11:48.948269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:11:48.959693 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:11:48.960300 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:11:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:48.980632 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] No DVR routers for this DVR port 0cc6f513-6305-463b-bb1d-17ec8928f67c on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:11:48.983759 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:48.987351 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 req-f8848d5d-7d8e-45e3-b948-53f0e37b1680 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "DELETE /v2.0/ports/0cc6f513-6305-463b-bb1d-17ec8928f67c HTTP/1.1" status: 204 len: 173 time: 0.8810420 Nov 24 16:11:48.987800 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-deleted', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:11:48.990044 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de553655-1ff3-472f-85a9-9a1e6882c51a" -d '{"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-deleted", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:11:49.035977 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:11:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c76d4c0d-3291-44e3-bb6d-101ce7602818 x-openstack-request-id: req-c76d4c0d-3291-44e3-bb6d-101ce7602818 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:11:49.036714 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-deleted", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:11:49.036714 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-c76d4c0d-3291-44e3-bb6d-101ce7602818 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:11:49.036966 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6', 'name': 'network-vif-deleted', 'tag': '0cc6f513-6305-463b-bb1d-17ec8928f67c', 'status': 'completed', 'code': 200} Nov 24 16:11:49.073530 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:11:49.270738 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:49.299892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:11:49.309866 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:11:49.310477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:11:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:49.418711 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:11:49.708190 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38424) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:49.753804 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:11:49.764512 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:49.782106 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb7da93-b578-4778-b19f-229892405ac5 None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:11:49.789205 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:49.843990 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:49.846946 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:49.848204 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /v2.0/security-groups/4aeec843-cb50-445f-8ffc-28ad4505fe5b HTTP/1.1" status: 204 len: 168 time: 0.1388338 Nov 24 16:11:49.851095 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38426) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:49.858742 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37402fa7-7b13-4cd9-8980-291c2ad10150 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4aeec843-cb50-445f-8ffc-28ad4505fe5b,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:49.882472 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.api.v2.resource [None req-d82725a4-d2b6-4bee-bcbe-fd3365d8cf72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] show failed (client error): The resource could not be found. Nov 24 16:11:49.886587 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-d82725a4-d2b6-4bee-bcbe-fd3365d8cf72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups/4aeec843-cb50-445f-8ffc-28ad4505fe5b HTTP/1.1" status: 404 len: 347 time: 0.0335417 Nov 24 16:11:49.887204 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38428) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:50.020247 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Deleting port c71e42b6-5b44-40cf-b61f-d2da3621a0a7 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:11:50.020596 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.037384 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c12388e-0671-450f-a51c-4a3de9a381ae None None] New status for floating IP d3f1f528-0574-41d3-824e-682325c3b706: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:11:50.104476 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.104805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.122639 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling delete_port for c71e42b6-5b44-40cf-b61f-d2da3621a0a7 owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:11:50.272066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.296274 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'Port': ['ID=c71e42b6-5b44-40cf-b61f-d2da3621a0a7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:50.358273 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.360774 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:50.361960 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-17790625-a119-4b60-8985-592a8cfd4096 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /v2.0/floatingips/d3f1f528-0574-41d3-824e-682325c3b706 HTTP/1.1" status: 204 len: 168 time: 0.4737847 Nov 24 16:11:51.266193 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-946c30ec-1324-4625-957d-15cecb320375 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.584076 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38434) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:51.589155 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group': {'name': 'tempest-securitygroup--884931115', 'description': 'tempest-description--291620100'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:51.611787 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.676858 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.680708 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.709498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.710712 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.1255858 Nov 24 16:11:51.713147 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4845835-b44c-4773-add3-988754476399 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroup': ['ID=71870c06-174e-486c-ac20-e4e17ae76723,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:51.713816 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38436) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:51.718323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group_rule': {'security_group_id': '71870c06-174e-486c-ac20-e4e17ae76723', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:51.748866 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.793965 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.798136 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.817557 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e912a6c7-6038-463f-91d1-cb01a5d3f185,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:51.827178 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.828383 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-1ffbd511-b512-41f6-9da0-5948b1f84eab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1135929 Nov 24 16:11:51.831167 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38438) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:51.835619 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'security_group_rule': {'security_group_id': '71870c06-174e-486c-ac20-e4e17ae76723', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:51.861790 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.916253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.919746 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.934616 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de87cc32-8a7e-48cf-98d8-113d6e4ce1be,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:51.945765 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:51.946949 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-58274ff1-c5db-4e5f-add5-ad3b26d99998 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1148298 Nov 24 16:11:51.949990 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38440) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:11:51.954817 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:51.978197 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.073821 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.173015 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Allocated IP 172.27.0.235 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/507470e5-6137-42d0-8a90-f2ca32d88103) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:11:52.276845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.310144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.347503 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:11:52.352216 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:11:52.355612 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:11:52.379416 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=507470e5-6137-42d0-8a90-f2ca32d88103,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:52.480570 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.510860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:11:52.517712 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.531487 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 0cc6f513-6305-463b-bb1d-17ec8928f67c {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:11:52.531836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0cc6f513-6305-463b-bb1d-17ec8928f67c not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:11:52.650216 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.687021 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.691973 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.759970 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=507470e5-6137-42d0-8a90-f2ca32d88103,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:52.772126 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.788252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:52.789574 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2591d6fc-32ab-4d96-97e5-7c3506c245f8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8386388 Nov 24 16:11:52.985600 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-84dd3e55-9fb2-41f6-886b-80def8ad5f97 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--884931115&fields=id&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 267 time: 0.0452573 Nov 24 16:11:53.089329 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-69483a42-2bfc-42b8-98e9-4f54e2b647c5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:53.090775 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-69483a42-2bfc-42b8-98e9-4f54e2b647c5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 816 time: 0.0984101 Nov 24 16:11:53.105676 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-bfc08d45-696b-4c15-8f5e-634907c58c61 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/quotas/4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 375 time: 0.0090265 Nov 24 16:11:53.156814 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-3da03000-271f-4f4a-b36d-7dfb7b26c11c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0452466 Nov 24 16:11:53.254380 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-61ea0252-1103-4fd5-9437-7d1b7a565e89 service neutron] 10.222.0.72 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863678 Nov 24 16:11:53.346552 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-21c163d1-cb61-4a9a-9f1a-aa09872b7f8a service neutron] 10.222.0.72 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862060 Nov 24 16:11:53.507280 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 req-56c37a1e-d611-462c-bef2-674adf765759 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 210 time: 0.0296948 Nov 24 16:11:54.318049 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:54.419207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-d2e1aabb-c6ec-44b2-af20-cd4d255e1502 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:54.421392 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-d2e1aabb-c6ec-44b2-af20-cd4d255e1502 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 816 time: 0.1016989 Nov 24 16:11:54.464576 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:54.489951 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-5d289528-83cd-44ce-9b2f-a7c70e3a12b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 379 time: 0.0588152 Nov 24 16:11:54.503020 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'port': {'device_id': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'admin_state_up': True, 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'security_groups': ['71870c06-174e-486c-ac20-e4e17ae76723']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:54.620122 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa req-8428567b-41eb-4751-aac7-d1f82e83481c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 210 time: 0.0363359 Nov 24 16:11:54.641545 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Made reservation on behalf of 4ca913475fb04e7a8ea75d95578c8b84 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:11:54.645480 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:54.774899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Allocated IP 172.20.0.7 (282e5dca-255c-487d-a4fd-a70d7293f6b8/2243cd13-32e0-4ca8-9d04-3e463c6c8988/4d38b5c2-e149-4f9c-bcdf-1f06131c0c44) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:11:54.906872 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:54.943895 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:54.987723 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:11:54.990643 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:11:54.994484 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:11:55.001593 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:55.048414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.049071 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.065430 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-ab5b3791-8f28-49d7-bd32-94941c0bf3ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5669725 Nov 24 16:11:55.145084 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Request body: {'port': {'device_id': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:11:55.200012 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.232212 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-42c7dd9b-8d54-4a1d-9e4e-e5568cc48e13 None None] Provisioning complete for port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:11:55.232829 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-42c7dd9b-8d54-4a1d-9e4e-e5568cc48e13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.269729 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-42c7dd9b-8d54-4a1d-9e4e-e5568cc48e13 None None] Port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:11:55.463469 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:11:55.470885 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.482867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Transition to ACTIVE for port object 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:11:55.486497 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.539364 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:55.607172 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Attempting to bind port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:11:55.608058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Attempting to bind port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:11:55.608447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Attempting to bind port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:11:55.613230 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:11:55.613553 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Attempting to bind port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 on network 282e5dca-255c-487d-a4fd-a70d7293f6b8 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:11:55.618839 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 11, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:11:55.619179 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Checking segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:11:55.619562 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Bound using segment: {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:11:55.619981 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Bound port: 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4ba13f07-5206-4f2b-9083-f91096492150', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1047, 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:11:55.620461 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.686174 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:11:55.689495 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:11:55.694141 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.729140 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.729946 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:11:55.731548 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] 10.222.0.71 "PUT /v2.0/ports/4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 1093 time: 0.5911224 Nov 24 16:11:55.732087 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:11:55.735064 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdcb8297-b532-485e-989c-4f37fb17e0fe" -d '{"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:11:55.760953 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 req-6273dacf-5155-47d9-812b-1e4fc85a9ac0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.762761 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 req-6273dacf-5155-47d9-812b-1e4fc85a9ac0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0650051 Nov 24 16:11:55.771695 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f4f568-5b11-4a9d-af56-1a0bafdc9b1d service neutron] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:11:55.778837 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:11:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 x-openstack-request-id: req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:11:55.779132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:11:55.780194 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:11:55.780745 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'status': 'completed', 'code': 200} Nov 24 16:11:55.828239 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 req-5566cc06-75af-4427-b9e6-c8950b044d97 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543907 Nov 24 16:11:55.839398 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-fe473ee2-1971-48d2-a28f-83c2159d837a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.841171 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-fe473ee2-1971-48d2-a28f-83c2159d837a service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1096 time: 0.0590358 Nov 24 16:11:55.890321 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-85a03c9f-11b8-4e13-921f-1fbf4df026dd service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 217 time: 0.0385911 Nov 24 16:11:55.939652 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-a620f35c-c7ad-4853-bb45-8ceac9f7ddc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.941111 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-a620f35c-c7ad-4853-bb45-8ceac9f7ddc0 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0438440 Nov 24 16:11:55.986121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-f76bcca3-84a4-46a4-9270-adb4c9f05594 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:55.987472 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-f76bcca3-84a4-46a4-9270-adb4c9f05594 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390813 Nov 24 16:11:56.082095 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-e85178d2-107b-46ef-9219-aed80bc44e89 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869482 Nov 24 16:11:56.172130 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 req-226ca02c-666a-45e4-8b7b-5ed760fa916d service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823324 Nov 24 16:11:56.264813 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-1ef7e1a4-c824-42e4-86b8-be0da216bb9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:56.266249 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-1ef7e1a4-c824-42e4-86b8-be0da216bb9b service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1096 time: 0.0453980 Nov 24 16:11:56.358509 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-57008bf4-0d5b-444e-91c1-0ad4d9b5b7af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:56.359978 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-57008bf4-0d5b-444e-91c1-0ad4d9b5b7af service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0851545 Nov 24 16:11:56.403731 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-987e77aa-2d13-4cf2-9449-31ca3357076d service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 217 time: 0.0359716 Nov 24 16:11:56.451840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-5fff12ad-6763-4165-9f84-eed649d008af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:56.453317 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-5fff12ad-6763-4165-9f84-eed649d008af service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0424824 Nov 24 16:11:56.505320 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-aefbf4fd-2f87-45ae-a773-a3e5bab2a6f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:56.506846 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-aefbf4fd-2f87-45ae-a773-a3e5bab2a6f8 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442986 Nov 24 16:11:56.600480 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-312010df-9062-452f-b94d-9f2527f7c30a service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853689 Nov 24 16:11:56.688396 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-3f9e608a-a002-4952-9d10-b2f19dd4903d service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803869 Nov 24 16:11:56.953091 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67cd99f-5297-4ad4-96c6-dac4dd971639 req-26660069-b877-4c32-9fa6-fc75b24247d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:56.954584 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f67cd99f-5297-4ad4-96c6-dac4dd971639 req-26660069-b877-4c32-9fa6-fc75b24247d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0489807 Nov 24 16:11:57.004872 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f67cd99f-5297-4ad4-96c6-dac4dd971639 req-06034cce-6fc0-405f-bda6-cc0457297c3c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443017 Nov 24 16:11:58.122959 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc req-eea190f7-e2a7-412b-b5d3-de63320e7f62 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:58.124693 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc req-eea190f7-e2a7-412b-b5d3-de63320e7f62 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0484467 Nov 24 16:11:58.171468 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc req-ef0e6449-b89f-448e-809c-c426d9fb9972 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407720 Nov 24 16:11:59.290937 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c req-ff9ba4ad-b7e1-4dfd-a33e-37d93231602f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:11:59.292408 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c req-ff9ba4ad-b7e1-4dfd-a33e-37d93231602f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0475395 Nov 24 16:11:59.339020 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c req-06910521-7474-4a76-a09d-6cef1261cc9b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399895 Nov 24 16:12:00.460563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629483e8-3732-4a3c-a839-0281189282d4 req-1e1b6eb8-af38-4e03-bce4-9f811406b23b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:00.462042 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-629483e8-3732-4a3c-a839-0281189282d4 req-1e1b6eb8-af38-4e03-bce4-9f811406b23b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0529685 Nov 24 16:12:00.508928 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-629483e8-3732-4a3c-a839-0281189282d4 req-f68c1a26-7926-4c08-a619-4da3210c328b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404134 Nov 24 16:12:00.541431 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:12:00.640991 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:00.652090 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:12:00.688360 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:00.700721 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:12:00.720131 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:00.724023 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:00.772421 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:00.779877 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.780261 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.780610 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.780953 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.781316 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.781651 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.782044 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.782312 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.782639 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.782965 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.783287 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:00.783608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:01.081130 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:12:01.631301 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de11fffb-8e90-415c-b137-465573f79c95 req-587103a8-ddba-43a0-83f5-b5e3dd5e00ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:01.632772 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-de11fffb-8e90-415c-b137-465573f79c95 req-587103a8-ddba-43a0-83f5-b5e3dd5e00ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 944 time: 0.0486617 Nov 24 16:12:01.678913 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-de11fffb-8e90-415c-b137-465573f79c95 req-86d976fa-6496-490c-954f-928341933386 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402529 Nov 24 16:12:02.552135 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:12:02.600656 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:12:02.604616 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:12:02.604994 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:02.685455 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:02.707957 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:02.710206 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83ce1526-8eb7-44c7-89a4-2a22da5cb058" -d '{"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:02.723140 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:02.728379 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:02.778536 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:02.808366 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a req-93e0c65f-fffe-4b71-9467-7820322d688a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:02.809810 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a req-93e0c65f-fffe-4b71-9467-7820322d688a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0567613 Nov 24 16:12:02.866912 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a req-600b9034-de6f-4996-88d3-b249ebcc80b0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508420 Nov 24 16:12:02.904859 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bdf5e6db-078a-4858-be37-c296949cc453 x-openstack-request-id: req-bdf5e6db-078a-4858-be37-c296949cc453 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:02.905219 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:02.905500 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-bdf5e6db-078a-4858-be37-c296949cc453 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:02.905896 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'code': 200} Nov 24 16:12:03.072358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b417441e-9b71-4f8c-8810-f214c8fad583 req-44529935-c043-4759-9b48-34ebdd88f0b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:03.073076 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b417441e-9b71-4f8c-8810-f214c8fad583 req-44529935-c043-4759-9b48-34ebdd88f0b5 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1098 time: 0.0414808 Nov 24 16:12:03.117418 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b417441e-9b71-4f8c-8810-f214c8fad583 req-17bff442-787e-41af-b8d6-fa7df5a93383 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374966 Nov 24 16:12:03.993252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3489d603-bc42-4142-9469-c831a5dd777f req-5f417ff7-b1c1-41e6-b28b-2cbdad7c6989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:03.994769 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3489d603-bc42-4142-9469-c831a5dd777f req-5f417ff7-b1c1-41e6-b28b-2cbdad7c6989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0516629 Nov 24 16:12:04.042538 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3489d603-bc42-4142-9469-c831a5dd777f req-ec935a16-f14e-498a-8e62-908b1574415e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413995 Nov 24 16:12:05.002745 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:12:05.164618 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb33506-8341-4279-a65f-cfef1aea073b req-451083e5-fa6b-4758-864e-de10c4fb3da8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:05.165986 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dbb33506-8341-4279-a65f-cfef1aea073b req-451083e5-fa6b-4758-864e-de10c4fb3da8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0492685 Nov 24 16:12:05.211747 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dbb33506-8341-4279-a65f-cfef1aea073b req-b6b7992a-9ccc-4a79-a568-3ced17336284 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392852 Nov 24 16:12:05.327540 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585f01a8-9a4b-4aef-8984-40f6dbd5824d req-2f832c1a-0315-4c76-9c10-6802d516c8db tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:05.329095 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-585f01a8-9a4b-4aef-8984-40f6dbd5824d req-2f832c1a-0315-4c76-9c10-6802d516c8db tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0484095 Nov 24 16:12:05.337519 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38500) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:05.343378 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Request body: {'floatingip': {'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:05.383319 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:05.814747 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:05.818386 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:05.918151 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Floating IP 733175a7-f3aa-4d5d-8a5b-ef755cf9b812 associated. External IP: 172.27.0.235, port: 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44. Nov 24 16:12:06.122137 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:06.454283 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:06.459179 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:06.464862 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:06.474959 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:06.475571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:11:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:06.486039 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-946216ba-3795-4165-a361-1fbbad7815cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "PUT /v2.0/floatingips/733175a7-f3aa-4d5d-8a5b-ef755cf9b812 HTTP/1.1" status: 200 len: 991 time: 1.1474621 Nov 24 16:12:06.486632 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:06.489055 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35fcd696-3fca-4f32-82be-0c93dfce4430" -d '{"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:06.594267 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:06.597615 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b28f724-d642-4b65-b717-73087b70ffe4 x-openstack-request-id: req-1b28f724-d642-4b65-b717-73087b70ffe4 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:06.597913 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:06.599420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-1b28f724-d642-4b65-b717-73087b70ffe4 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:06.599420 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'status': 'completed', 'code': 200} Nov 24 16:12:06.664493 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-b461bf62-0517-46e3-b96a-3fe68bf3e309 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:06.666018 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-b461bf62-0517-46e3-b96a-3fe68bf3e309 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1098 time: 0.0443864 Nov 24 16:12:06.837292 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '733175a7-f3aa-4d5d-8a5b-ef755cf9b812', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.235', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:11:52Z', 'updated_at': '2021-11-24T16:12:05Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:06.864242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:06.874376 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:06.874992 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:11:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:06.988930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-c2655d53-dce3-4812-a1ad-b6b54af91b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:06.989212 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:06.990423 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-c2655d53-dce3-4812-a1ad-b6b54af91b33 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.3175709 Nov 24 16:12:07.058282 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-7be3eb67-8f91-4167-8721-4e74677a4e78 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 999 time: 0.0605125 Nov 24 16:12:07.105716 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-772d9e18-0b36-446f-a3af-ddc5a1a7c31d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:07.107611 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-772d9e18-0b36-446f-a3af-ddc5a1a7c31d service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0420692 Nov 24 16:12:07.153077 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-320a6c21-5a8b-451f-a2b6-320a397554e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:07.155188 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-320a6c21-5a8b-451f-a2b6-320a397554e9 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409739 Nov 24 16:12:07.217667 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '733175a7-f3aa-4d5d-8a5b-ef755cf9b812', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.235', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:11:52Z', 'updated_at': '2021-11-24T16:12:05Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:07.244882 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-480dd18c-773a-46f5-802a-61f8a3f480d7 None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '733175a7-f3aa-4d5d-8a5b-ef755cf9b812', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'floating_ip_address': '172.27.0.235', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:11:52Z', 'updated_at': '2021-11-24T16:12:05Z', 'revision_number': 1, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:07.246998 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-61f65a31-e567-4ad4-8a6f-7625a11dfef9 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846047 Nov 24 16:12:07.338279 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-01d30c37-caa4-4849-9a5c-f6f961a854ab service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844874 Nov 24 16:12:07.432395 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d891b177-1073-4af2-9f2c-1eeeef722c00 None None] New status for floating IP 733175a7-f3aa-4d5d-8a5b-ef755cf9b812: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:12:14.241775 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:17.514818 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-a5247f66-47c7-4ca4-a248-02d261f6e4d5 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0433264 Nov 24 16:12:17.579582 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-2915a0e5-757e-4f74-9c3b-f8ebb479d343 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:17.581098 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-2915a0e5-757e-4f74-9c3b-f8ebb479d343 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1138 time: 0.0405431 Nov 24 16:12:17.699050 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-a3de97a1-89b5-4fec-9eec-e933253d92ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:17.701357 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-a3de97a1-89b5-4fec-9eec-e933253d92ad service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.0942657 Nov 24 16:12:17.774362 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-a495da93-55af-4434-8499-9a2877e08a35 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 1001 time: 0.0616591 Nov 24 16:12:17.826757 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-9cde7533-fcfd-40da-9d4a-de831fe42ec3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:17.828159 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-9cde7533-fcfd-40da-9d4a-de831fe42ec3 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0414677 Nov 24 16:12:17.874075 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-63618c41-3583-48c8-96b3-77ff3ab2bc60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:17.875543 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-63618c41-3583-48c8-96b3-77ff3ab2bc60 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394745 Nov 24 16:12:17.967784 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-a1e0606b-8834-453e-863b-5524d3bfd1f5 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833778 Nov 24 16:12:18.061692 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0498a707-be5a-4d08-a739-5e46eb02e893 req-fac75e98-7801-4cb0-a1b3-9fed10b45bbb service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843327 Nov 24 16:12:18.610897 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-e46ebc90-f2b6-4b3e-b074-9e13973e50ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:21.267944 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5e80faf7-a353-439a-9a87-8da3aeeb528e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:21.676129 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 req-18e98754-2997-44ec-ac0a-3b2b33b3b028 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:21.677621 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 req-18e98754-2997-44ec-ac0a-3b2b33b3b028 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0509911 Nov 24 16:12:21.724999 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 req-d21bda9d-4cbe-493f-90cf-480afba1712a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412991 Nov 24 16:12:22.644077 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:22.847358 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 req-59abef4c-b59e-497b-b380-cf6d0cb0dfd6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:22.848851 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 req-59abef4c-b59e-497b-b380-cf6d0cb0dfd6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0486434 Nov 24 16:12:22.901323 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 req-e5e9e7d6-4021-48db-b4d5-449d96874b78 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=02cc4580-8087-45ad-aad7-b9f490777df0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461516 Nov 24 16:12:22.993434 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61492975-2b77-401e-b521-6faf4402c796 req-313a1886-c6be-4d83-9dc2-5a093d506f8f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:22.994894 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-61492975-2b77-401e-b521-6faf4402c796 req-313a1886-c6be-4d83-9dc2-5a093d506f8f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 945 time: 0.0485125 Nov 24 16:12:23.081633 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Deleting port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:23.081971 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.169515 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] For port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:23.169873 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.333482 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.333834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.334149 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Floating IP 2f7c879e-de1b-4cc7-bfab-deb48490ee3e disassociated. External IP: 172.27.0.109, port: 1c836e44-a6b1-400d-a64b-3d1e5a65fd29. Nov 24 16:12:23.334485 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling delete_port for 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:23.464643 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.494091 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'Port': ['ID=1c836e44-a6b1-400d-a64b-3d1e5a65fd29,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:23.607567 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:23.713414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:23.724788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:23.734570 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:23.735194 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:23.752631 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] No DVR routers for this DVR port 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:12:23.755894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:23.759238 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-61492975-2b77-401e-b521-6faf4402c796 req-22ea54d5-cc05-4bd9-a9bc-3e01a48cfc35 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "DELETE /v2.0/ports/1c836e44-a6b1-400d-a64b-3d1e5a65fd29 HTTP/1.1" status: 204 len: 173 time: 0.7581782 Nov 24 16:12:23.759748 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'name': 'network-vif-deleted', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:23.761999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-923befd0-34a4-46cd-b73f-1827aaa38d52" -d '{"events": [{"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-deleted", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:23.803202 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 x-openstack-request-id: req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:23.803484 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-deleted", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:23.803743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:23.804140 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80f67d55-afc9-4ce8-a9c5-8256298c4b7e', 'name': 'network-vif-deleted', 'tag': '1c836e44-a6b1-400d-a64b-3d1e5a65fd29', 'status': 'completed', 'code': 200} Nov 24 16:12:23.848626 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:24.023068 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 req-166ff614-9013-48c5-834f-968399c977b0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=80f67d55-afc9-4ce8-a9c5-8256298c4b7e HTTP/1.1" status: 200 len: 210 time: 0.0298429 Nov 24 16:12:24.078407 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:24.108296 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:24.116435 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:24.117059 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:24.348271 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:24.359170 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:24.497230 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:24.568719 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:24.600092 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea81498-2e63-455c-9c6e-00b8eee610db None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:24.813966 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9bc793f-c0a7-4ec0-a90b-7d132837f353 None None] New status for floating IP 2f7c879e-de1b-4cc7-bfab-deb48490ee3e: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:12:25.105099 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38568) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:25.159794 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.182564 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.228493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.231709 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.233052 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /v2.0/security-groups/02cc4580-8087-45ad-aad7-b9f490777df0 HTTP/1.1" status: 204 len: 168 time: 0.1268783 Nov 24 16:12:25.235829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38570) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:25.242020 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4c19e1-bce0-46ef-89e2-fce3d2a35d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=02cc4580-8087-45ad-aad7-b9f490777df0,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:25.251455 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.api.v2.resource [None req-7867617b-2369-40b0-b78f-aadc514e799d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] show failed (client error): The resource could not be found. Nov 24 16:12:25.252474 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-7867617b-2369-40b0-b78f-aadc514e799d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups/02cc4580-8087-45ad-aad7-b9f490777df0 HTTP/1.1" status: 404 len: 347 time: 0.0156279 Nov 24 16:12:25.255357 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38572) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:25.378035 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Deleting port dbc29241-9b3b-4575-a975-6400c574cbdc {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:25.378301 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.453131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.453467 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.464742 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling delete_port for dbc29241-9b3b-4575-a975-6400c574cbdc owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:25.598546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.620894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'Port': ['ID=dbc29241-9b3b-4575-a975-6400c574cbdc,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:25.685840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.688380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:25.689534 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-42ed7a0a-94ff-4046-859f-c24ed04ec5e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /v2.0/floatingips/2f7c879e-de1b-4cc7-bfab-deb48490ee3e HTTP/1.1" status: 204 len: 168 time: 0.4332809 Nov 24 16:12:26.191531 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38578) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:26.196190 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1337909886', 'description': 'tempest-description--1227847687'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:26.221956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.287397 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.291081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.321267 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.322680 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1300397 Nov 24 16:12:26.325036 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c569356-589f-45ad-bedc-0b7277711c61 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroup': ['ID=745f559c-3d80-495a-8a2a-2d7ac697d872,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:26.325835 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38580) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:26.331053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group_rule': {'security_group_id': '745f559c-3d80-495a-8a2a-2d7ac697d872', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:26.359097 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.413677 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.417337 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.436316 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d4adfe2-aafe-493f-afe4-3f4d45038fd1,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:26.446241 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.447513 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-24758308-0bc0-4f6f-a985-33131de19638 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1205146 Nov 24 16:12:26.450360 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38582) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:26.454716 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'security_group_rule': {'security_group_id': '745f559c-3d80-495a-8a2a-2d7ac697d872', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:26.482350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.537093 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.540760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.558814 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=78459c05-895a-4d83-9c2b-a94ef145dcf2,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:26.567419 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.568702 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-4ef79af4-4575-4ac5-94bb-b2d62768caf6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1173148 Nov 24 16:12:26.571848 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38584) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:26.577047 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:26.601888 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.687048 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:26.700704 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.707282 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:26.707629 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1c836e44-a6b1-400d-a64b-3d1e5a65fd29 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:26.815854 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Allocated IP 172.27.0.214 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/6fab1473-c03d-472a-b867-7a71a408c15b) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:12:26.924237 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:26.957956 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.001318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:12:27.004078 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:12:27.007429 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:12:27.030696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=6fab1473-c03d-472a-b867-7a71a408c15b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:27.097532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.131566 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.283268 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.287602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.352266 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=6fab1473-c03d-472a-b867-7a71a408c15b,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:27.366000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.381771 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:27.391503 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c2c88e80-3b93-4bc5-a89a-650daa73e6da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8102441 Nov 24 16:12:27.591049 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-60fa7bf2-9390-4b8f-ba14-925562f9f865 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--1337909886&fields=id&tenant_id=1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 267 time: 0.0447669 Nov 24 16:12:27.697868 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-41ae9f67-1799-442e-a475-23ff98a09606 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:27.699346 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-41ae9f67-1799-442e-a475-23ff98a09606 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 811 time: 0.1016335 Nov 24 16:12:27.714707 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-b1f28eea-2718-45bf-9e79-6a1622011012 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/quotas/1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 375 time: 0.0092273 Nov 24 16:12:27.766431 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-7df31628-4419-430b-b8df-361fe555af70 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0458019 Nov 24 16:12:27.864403 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-ed9fe960-f79d-4de9-9b9b-5cfc1166d923 service neutron] 10.222.0.72 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865061 Nov 24 16:12:27.950416 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8976a16c-fbb8-4b04-a55b-100571b1e24c service neutron] 10.222.0.72 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799580 Nov 24 16:12:28.111414 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0e082bca-08ba-400f-bb7e-a50751ae31e9 req-9fb33814-f7fd-4b95-be2c-4f3b59db6d09 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 210 time: 0.0284257 Nov 24 16:12:29.051571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-476cde94-7c09-44df-90e0-7b10c9e567ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:29.053011 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-476cde94-7c09-44df-90e0-7b10c9e567ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 811 time: 0.1027441 Nov 24 16:12:29.114609 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-13d69ab6-4abc-4740-8d92-30097549486d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1c341b845ae6468b847beba4eee796dd HTTP/1.1" status: 200 len: 380 time: 0.0509384 Nov 24 16:12:29.127126 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'port': {'device_id': 'c8582c22-790a-4760-84f8-78b7929748d3', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'admin_state_up': True, 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'security_groups': ['745f559c-3d80-495a-8a2a-2d7ac697d872']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:29.214486 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 req-26da18b6-f404-42b8-a019-c165dfff42f4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 210 time: 0.0290692 Nov 24 16:12:29.256846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Made reservation on behalf of 1c341b845ae6468b847beba4eee796dd for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:12:29.260278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.381940 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Allocated IP 172.20.0.7 (d785b693-1522-4c61-9c47-37993ec7d517/6f721a8b-2f8a-4509-b0fb-4eea2f82fd87/e95db78b-d6c2-46b5-b57f-c37954356d5c) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:12:29.516998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.548827 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.596090 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Network d785b693-1522-4c61-9c47-37993ec7d517 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:12:29.599001 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:12:29.602864 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:12:29.609584 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event updated for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:29.656565 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:29.657186 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.674018 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-c167ab24-7ca3-4701-bfd1-155d8c4dfbfd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5505066 Nov 24 16:12:29.693255 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Request body: {'port': {'device_id': 'c8582c22-790a-4760-84f8-78b7929748d3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:29.748843 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.862955 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-3d055de4-21e9-426a-a20f-22bdf788c19c None None] Provisioning complete for port e95db78b-d6c2-46b5-b57f-c37954356d5c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:12:29.863574 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3d055de4-21e9-426a-a20f-22bdf788c19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:29.897847 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-3d055de4-21e9-426a-a20f-22bdf788c19c None None] Port e95db78b-d6c2-46b5-b57f-c37954356d5c cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:12:30.005590 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e95db78b-d6c2-46b5-b57f-c37954356d5c {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:12:30.013157 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:30.024583 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Transition to ACTIVE for port object e95db78b-d6c2-46b5-b57f-c37954356d5c will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:12:30.028673 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:30.077339 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Pushing event updated for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:30.151446 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Attempting to bind port e95db78b-d6c2-46b5-b57f-c37954356d5c on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:12:30.151847 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Attempting to bind port e95db78b-d6c2-46b5-b57f-c37954356d5c by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:12:30.153591 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Attempting to bind port e95db78b-d6c2-46b5-b57f-c37954356d5c on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:12:30.158119 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Port e95db78b-d6c2-46b5-b57f-c37954356d5c on network d785b693-1522-4c61-9c47-37993ec7d517 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:12:30.158472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Attempting to bind port e95db78b-d6c2-46b5-b57f-c37954356d5c on network d785b693-1522-4c61-9c47-37993ec7d517 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:12:30.163898 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:12:30.164233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Checking segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:12:30.164618 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Bound using segment: {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:12:30.165058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Bound port: e95db78b-d6c2-46b5-b57f-c37954356d5c, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '74f01bad-61a2-41c6-9cce-ac0e3acebb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1041, 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:12:30.165541 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:30.233315 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:12:30.236443 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:12:30.241598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:30.276862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.278151 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:30.279748 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] 10.222.0.71 "PUT /v2.0/ports/e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 200 len: 1093 time: 0.5908608 Nov 24 16:12:30.280180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:30.282462 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ee5e1d3-5c8a-4610-8518-b663ec964321" -d '{"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:30.332395 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 x-openstack-request-id: req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:30.332806 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:30.332953 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:30.333375 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'status': 'completed', 'code': 200} Nov 24 16:12:30.337969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8191bb4c-3f2b-45af-8ea1-2037f8f3fbc2 service neutron] Pushing event updated for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:30.384462 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56690346-e4aa-4159-b67a-3a42ba6c9e62 req-8e813bb8-8fb2-4deb-9002-503c939c61ae tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.385991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-56690346-e4aa-4159-b67a-3a42ba6c9e62 req-8e813bb8-8fb2-4deb-9002-503c939c61ae tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 943 time: 0.0962484 Nov 24 16:12:30.418894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-a4e7e179-2207-4ef8-81d0-df73fa884f9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.420409 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-a4e7e179-2207-4ef8-81d0-df73fa884f9b service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 1096 time: 0.0724177 Nov 24 16:12:30.477566 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-8bc612c8-3be9-47f1-835d-e0e522b8a6ef service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 200 len: 217 time: 0.0474539 Nov 24 16:12:30.481815 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-56690346-e4aa-4159-b67a-3a42ba6c9e62 req-2bc93739-7e63-48cc-b44e-d8fda98ae886 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0887523 Nov 24 16:12:30.532998 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-7b6a17fe-e908-4979-ac57-098a15c50e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.534513 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-7b6a17fe-e908-4979-ac57-098a15c50e93 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0463529 Nov 24 16:12:30.588955 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-2f37b755-5fd1-4271-a4b9-ae6e91acd33f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.591135 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-2f37b755-5fd1-4271-a4b9-ae6e91acd33f service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0478137 Nov 24 16:12:30.680987 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-aad522c9-8c7b-41d5-aec4-3b6cd998be41 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821514 Nov 24 16:12:30.774793 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b529b02-11cf-4885-8f17-b9cf14077a12 req-f4a3aacd-359c-48b0-b4c2-733fc502194b service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856619 Nov 24 16:12:30.868652 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-db3b4c12-de5a-49ee-ae91-28dc98e169d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:30.870180 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-db3b4c12-de5a-49ee-ae91-28dc98e169d3 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 1096 time: 0.0415292 Nov 24 16:12:31.183862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-871e6038-d9f4-461f-ab93-a9c645a408b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:31.185409 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-871e6038-d9f4-461f-ab93-a9c645a408b8 service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.3079703 Nov 24 16:12:31.231291 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-707b2220-ec60-4a9a-b4e9-b197a90da47c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 200 len: 217 time: 0.0343108 Nov 24 16:12:31.278834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-a26d53ac-bbf4-432e-beb3-9ea9e42314bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:31.280224 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-a26d53ac-bbf4-432e-beb3-9ea9e42314bc service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0423682 Nov 24 16:12:31.329730 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-4066b0aa-ebad-4e39-95ae-8fb62513ade1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:31.331300 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-4066b0aa-ebad-4e39-95ae-8fb62513ade1 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435393 Nov 24 16:12:31.419487 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-0e413762-b259-41a5-bb5b-b3c43585d3ab service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795517 Nov 24 16:12:31.511519 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-a763be7b-f46b-4229-be1f-d698d0a92d83 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823216 Nov 24 16:12:31.604915 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7631d867-5012-4bde-ba33-d0053abe7089 req-77936d17-0b96-4e1a-981d-8889f468e1a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:31.606240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7631d867-5012-4bde-ba33-d0053abe7089 req-77936d17-0b96-4e1a-981d-8889f468e1a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 943 time: 0.0515099 Nov 24 16:12:31.655781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7631d867-5012-4bde-ba33-d0053abe7089 req-81acce75-bb60-4be0-a345-a734c8c6cd07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437934 Nov 24 16:12:32.770117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fc70c4-869f-48c0-9acf-68d4b7b87fef req-2fc81389-e55c-437d-b0ff-c2b7d7930767 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:32.771609 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-64fc70c4-869f-48c0-9acf-68d4b7b87fef req-2fc81389-e55c-437d-b0ff-c2b7d7930767 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 943 time: 0.0481739 Nov 24 16:12:32.824029 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-64fc70c4-869f-48c0-9acf-68d4b7b87fef req-77c26eab-440c-47dc-b96c-a34ceece42ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439336 Nov 24 16:12:33.940602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d696cce3-f98d-4585-8c74-4b77a0daacb4 req-396afe7b-87b9-4689-b0ee-830b70922672 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:33.942101 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d696cce3-f98d-4585-8c74-4b77a0daacb4 req-396afe7b-87b9-4689-b0ee-830b70922672 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 943 time: 0.0493150 Nov 24 16:12:33.989348 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d696cce3-f98d-4585-8c74-4b77a0daacb4 req-6dcb42f5-ce11-4fa6-bb48-e0e10f341039 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412483 Nov 24 16:12:34.718400 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device e95db78b-d6c2-46b5-b57f-c37954356d5c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:12:34.812768 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:34.827352 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'port_id': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'mac_address': 'fa:16:3e:a8:21:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1041, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:12:34.864743 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:34.878954 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e95db78b-d6c2-46b5-b57f-c37954356d5c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:12:34.898450 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:34.902819 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:34.952932 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:35.103775 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a07418-2972-4852-b147-049b68f3d8e3 req-c3b5e9a2-9bc6-4996-b8b2-f95c91ff7a96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:35.105443 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6a07418-2972-4852-b147-049b68f3d8e3 req-c3b5e9a2-9bc6-4996-b8b2-f95c91ff7a96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 944 time: 0.0488951 Nov 24 16:12:35.152729 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6a07418-2972-4852-b147-049b68f3d8e3 req-8108ed8d-1bed-409a-a099-7b01bfd89a7b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411501 Nov 24 16:12:35.238289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['e95db78b-d6c2-46b5-b57f-c37954356d5c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:12:36.276702 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d req-9f615000-0998-4d27-98c7-51d84e9e30fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:36.278868 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d req-9f615000-0998-4d27-98c7-51d84e9e30fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 944 time: 0.0588810 Nov 24 16:12:36.327716 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d req-988ae746-5bac-4856-a146-5f1c0594c8a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427248 Nov 24 16:12:36.733225 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device e95db78b-d6c2-46b5-b57f-c37954356d5c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:12:36.792412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port e95db78b-d6c2-46b5-b57f-c37954356d5c completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:12:36.796659 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port e95db78b-d6c2-46b5-b57f-c37954356d5c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:12:36.797057 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:36.897734 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:36.921978 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:36.924280 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d95e9dc-e411-4202-963c-ef660e1a4d44" -d '{"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-plugged", "status": "completed", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:36.939151 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:36.943262 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:36.970461 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eea7b481-ce99-491a-a234-262873e39c9f x-openstack-request-id: req-eea7b481-ce99-491a-a234-262873e39c9f {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:36.970785 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-plugged", "status": "completed", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:36.971045 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-eea7b481-ce99-491a-a234-262873e39c9f {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:36.971439 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'code': 200} Nov 24 16:12:36.997566 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:37.151131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523ac974-b10d-45e9-be5e-586e45d65485 req-ca5181b5-1009-40ca-a489-425a260ebaa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:37.153246 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-523ac974-b10d-45e9-be5e-586e45d65485 req-ca5181b5-1009-40ca-a489-425a260ebaa9 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 1098 time: 0.0414240 Nov 24 16:12:37.200815 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-523ac974-b10d-45e9-be5e-586e45d65485 req-fa98f064-94a9-4046-afb4-5531adfe3b63 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396874 Nov 24 16:12:37.448032 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 req-c14e3bc8-b6dd-4004-a8c9-3a9acf530b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:37.449547 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 req-c14e3bc8-b6dd-4004-a8c9-3a9acf530b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0525775 Nov 24 16:12:37.509704 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 req-bc750ff8-a0d8-419c-981f-8e7a30336cc2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542803 Nov 24 16:12:38.632707 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c721be1f-305a-4475-9ffd-1f2ebf94f233 req-b905f9ea-3eb9-4e89-9929-9598528f3ad0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:38.634236 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c721be1f-305a-4475-9ffd-1f2ebf94f233 req-b905f9ea-3eb9-4e89-9929-9598528f3ad0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0551865 Nov 24 16:12:38.681157 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c721be1f-305a-4475-9ffd-1f2ebf94f233 req-54fc67a9-99aa-48bf-8501-9b403dab5016 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406804 Nov 24 16:12:39.800147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dbadeb9-b7ae-41e8-805b-062939ab061f req-bc48b2a1-3b03-4248-9bc2-620df04eec32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:39.801644 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3dbadeb9-b7ae-41e8-805b-062939ab061f req-bc48b2a1-3b03-4248-9bc2-620df04eec32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0520270 Nov 24 16:12:39.847969 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3dbadeb9-b7ae-41e8-805b-062939ab061f req-a0c5931f-4797-494f-a6d0-c9ca11a898e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403690 Nov 24 16:12:39.961175 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c req-6f59cff2-0a8a-4476-8800-36c2496f6d49 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:39.962606 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c req-6f59cff2-0a8a-4476-8800-36c2496f6d49 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0483656 Nov 24 16:12:39.972048 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38664) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:39.976440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Request body: {'floatingip': {'port_id': 'e95db78b-d6c2-46b5-b57f-c37954356d5c'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:40.017762 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:40.441354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:40.445527 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:40.542417 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Floating IP c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f associated. External IP: 172.27.0.214, port: e95db78b-d6c2-46b5-b57f-c37954356d5c. Nov 24 16:12:40.762653 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-825fc1f7-97a6-4c8f-ae8a-b1480bd4a3d4 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1392222549&fields=id&tenant_id=3b09c1b1b2994015967d00aba299005b HTTP/1.1" status: 200 len: 267 time: 0.0852098 Nov 24 16:12:40.802252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:40.827450 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-db5528f0-cbab-4263-911c-d96c6960ef7e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:40.828912 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-db5528f0-cbab-4263-911c-d96c6960ef7e tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 985 time: 0.0593162 Nov 24 16:12:40.866372 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Request body: {'port': {'security_groups': ['48b8a254-8580-4ea5-aa35-4dfce9b414ab']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:12:40.977414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:40.994931 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:41.001448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.005500 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:41.015058 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:41.015694 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:41.068832 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-92f03665-c3bb-4394-8ebf-82b85019fbd9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "PUT /v2.0/floatingips/c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f HTTP/1.1" status: 200 len: 991 time: 1.0955186 Nov 24 16:12:41.074131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:41.076258 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e" -d '{"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:41.126154 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:41.190184 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd923471-1886-430a-a2fa-92605b8c63b0 x-openstack-request-id: req-fd923471-1886-430a-a2fa-92605b8c63b0 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:41.190559 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:41.190865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-fd923471-1886-430a-a2fa-92605b8c63b0 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:41.191357 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'status': 'completed', 'code': 200} Nov 24 16:12:41.203725 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:41.262983 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.268256 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.283033 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-119b2d68-7f5d-4e08-a5ce-a564f1736e2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:41.284502 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-119b2d68-7f5d-4e08-a5ce-a564f1736e2c service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 1098 time: 0.0710380 Nov 24 16:12:41.287326 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:12:41.328960 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:41.329730 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.331144 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-92771a05-df5d-4f0f-a433-eeb0fd58537c req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "PUT /v2.0/ports/fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 943 time: 0.4704831 Nov 24 16:12:41.339025 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38676) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:41.398453 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cec2afc-1f60-4a85-912e-fe6c5ff55b7c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event updated for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=7']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:41.403435 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.424831 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:12:41.439974 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-7567212e-2896-4057-b227-8939d67c9731 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:41.440463 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.441498 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-7567212e-2896-4057-b227-8939d67c9731 service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.1375132 Nov 24 16:12:41.521551 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.526422 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.531655 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-799beddb-bb18-40c2-94be-104b10756136 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 200 len: 999 time: 0.0787752 Nov 24 16:12:41.532476 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /v2.0/security-groups/497983bf-eca9-465b-ad1a-9718733e64c7 HTTP/1.1" status: 204 len: 168 time: 0.1906648 Nov 24 16:12:41.532598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38680) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:41.544694 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=497983bf-eca9-465b-ad1a-9718733e64c7,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:41.553253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.554203 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.554983 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.555765 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.556578 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.557294 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.557870 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.558647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.559209 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.559818 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.560380 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.560936 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca02cf5a-8654-4b32-baad-7d867b8f606c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:41.620541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.214', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 526, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:a8:21:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8582c22-790a-4760-84f8-78b7929748d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:12:27Z', 'updated_at': '2021-11-24T16:12:40Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:41.647761 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-64752b77-8c80-4112-9b4a-ce25c597c9a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:41.649345 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-64752b77-8c80-4112-9b4a-ce25c597c9a2 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0702209 Nov 24 16:12:41.672343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:41.709559 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:41.710331 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:41.711951 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2917aaa1-39c2-4317-b740-7f520350838f None None] Provisioning complete for port fe858985-c82e-488e-aceb-25ed4bffc8ee triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:12:41.712320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2917aaa1-39c2-4317-b740-7f520350838f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.754833 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-e56e9bd3-3f06-4a85-879c-4b562a577459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:41.756327 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-e56e9bd3-3f06-4a85-879c-4b562a577459 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0799265 Nov 24 16:12:41.829015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Deleting port 0aedd59b-4a4f-4ac3-835c-500fd987bc6e {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:41.829265 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:41.899555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:42.001561 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:12:42.136742 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-f04bdfcb-dde2-438b-8ecc-12b72d9afc7e service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3712468 Nov 24 16:12:42.144394 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.214', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 526, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:a8:21:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8582c22-790a-4760-84f8-78b7929748d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:12:27Z', 'updated_at': '2021-11-24T16:12:40Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:42.172414 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f9bd3e-ee99-4603-986f-38131dfdfb8e None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': 'c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'floating_ip_address': '172.27.0.214', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'port_id': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 526, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'mac_address': 'fa:16:3e:a8:21:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8582c22-790a-4760-84f8-78b7929748d3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:12:27Z', 'updated_at': '2021-11-24T16:12:40Z', 'revision_number': 1, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:42.178756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:42.179088 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:42.219398 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling delete_port for 0aedd59b-4a4f-4ac3-835c-500fd987bc6e owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:42.321811 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-92dafd0e-eb08-4560-ba9c-2c03f8532431 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1774700 Nov 24 16:12:42.387476 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-196b129b-2d2f-44b6-a40a-97909bcd9676 None None] New status for floating IP c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:12:42.429696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:42.458884 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event deleted for resources: {'Port': ['ID=0aedd59b-4a4f-4ac3-835c-500fd987bc6e,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:42.518581 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:42.518981 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Floating IP 348f83b6-a4f4-4849-97f8-a5b0646e467a disassociated (deleted). External IP: 172.27.0.14, port: fe858985-c82e-488e-aceb-25ed4bffc8ee. Nov 24 16:12:42.734295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Router 6b4ede60-92bd-4670-939a-9a888194c526 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:42.840782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:42.845252 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:42.850125 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Sync routers for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:42.866290 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:42.866930 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:42.875485 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d7c0e83a-ccd6-490a-bc25-ce4e43173cb1 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /v2.0/floatingips/348f83b6-a4f4-4849-97f8-a5b0646e467a HTTP/1.1" status: 204 len: 168 time: 1.3418884 Nov 24 16:12:43.111174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:43.192207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}, {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:43.194584 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-264782b9-dbb6-4fcc-a150-45d20598cc8c" -d '{"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}, {"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:43.237699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11c328ae-c09c-44a0-917a-abf294e53e73 x-openstack-request-id: req-11c328ae-c09c-44a0-917a-abf294e53e73 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:43.238000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:43.238256 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-11c328ae-c09c-44a0-917a-abf294e53e73 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:43.238660 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:12:43.238915 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:12:43.303278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-7b70c970-f3fb-46a7-89b5-d7faef36d322 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.304785 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-7b70c970-f3fb-46a7-89b5-d7faef36d322 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1099 time: 0.0423508 Nov 24 16:12:43.323169 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:43.353254 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Checking router: 6b4ede60-92bd-4670-939a-9a888194c526 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:43.362328 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:43.362922 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:43.409014 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-51499d4a-4071-4877-bbd8-5b0a84275f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.410534 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-51499d4a-4071-4877-bbd8-5b0a84275f2a service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.0876076 Nov 24 16:12:43.454242 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-66edde26-6955-47a6-8ac4-0a1ba37a3aa8 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 217 time: 0.0336225 Nov 24 16:12:43.470558 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:43.506499 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-1d0d81b6-1d67-4d13-ba93-f9e5ca01c004 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.507857 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-1d0d81b6-1d67-4d13-ba93-f9e5ca01c004 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0474644 Nov 24 16:12:43.557445 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-1c9a10ca-f7b3-484c-a5e7-4f6c2c592ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.559098 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-1c9a10ca-f7b3-484c-a5e7-4f6c2c592ca4 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428424 Nov 24 16:12:43.658592 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-361d81a0-53c5-4845-9897-c1866658819f service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919616 Nov 24 16:12:43.677354 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:43.704283 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d3748c2-f150-4f68-b188-0170517e9467 None None] The sync data for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi is: [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:07:50Z', 'revision_number': 4, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c7604272-2019-4eb1-b9f5-030ba5c460ea', 'name': '', 'network_id': '5bfa1501-ec44-4dcf-b786-02db2672e4a7', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'mac_address': 'fa:16:3e:f0:bb:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:49Z', 'updated_at': '2021-11-24T16:07:56Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'subnets': [{'id': '639f9430-29e6-4689-9e38-afdda9766d8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:43.761875 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-546556fd-43f6-432a-85d6-ddb9f2875db9 service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949647 Nov 24 16:12:43.854919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9a4b4ca5-89ae-4630-b9ed-54ddda494fe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.856845 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9a4b4ca5-89ae-4630-b9ed-54ddda494fe3 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=3b09c1b1b2994015967d00aba299005b&device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 1099 time: 0.0433202 Nov 24 16:12:43.956708 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aed6034-74f6-4ab1-870c-fb7f3f47293c None None] New status for floating IP 348f83b6-a4f4-4849-97f8-a5b0646e467a: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:12:43.967851 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-23c111f6-5853-4232-b916-3970aae645e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:43.969349 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-23c111f6-5853-4232-b916-3970aae645e9 service neutron] 10.222.0.71 "GET /v2.0/networks?id=5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 200 len: 917 time: 0.0996780 Nov 24 16:12:44.009837 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-cff8557d-e1bb-4c4f-9fea-02e602da7cbb service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 200 len: 217 time: 0.0331337 Nov 24 16:12:44.072359 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9d8c7d16-8bd4-40fb-8d7d-c146aa885532 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:44.074663 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9d8c7d16-8bd4-40fb-8d7d-c146aa885532 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 200 len: 854 time: 0.0490165 Nov 24 16:12:44.119715 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9c4d730d-51d4-42b8-ab12-608e2717f4ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:44.121921 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-9c4d730d-51d4-42b8-ab12-608e2717f4ea service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5bfa1501-ec44-4dcf-b786-02db2672e4a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405619 Nov 24 16:12:44.212708 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-acb90e77-40d0-4a5b-8d2c-06487329561a service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836916 Nov 24 16:12:44.247049 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:44.312738 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-b2516123-b707-4883-9957-0357ea3b8f2b service neutron] 10.222.0.71 "GET /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926337 Nov 24 16:12:45.626592 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1515ef04-42fd-4b71-84a5-8800b624a612 req-eeec5192-2c64-4dcd-a7c9-6eba3a9b55aa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:45.628085 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1515ef04-42fd-4b71-84a5-8800b624a612 req-eeec5192-2c64-4dcd-a7c9-6eba3a9b55aa tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0499744 Nov 24 16:12:45.678584 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1515ef04-42fd-4b71-84a5-8800b624a612 req-2c8653d7-6ce0-461e-b5b7-5a0e77dba9ec tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444353 Nov 24 16:12:46.797617 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b60573-8755-401f-b77b-daea1238fc50 req-922b7ee2-da45-4057-bca0-43b86ca2caff tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:46.799103 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-92b60573-8755-401f-b77b-daea1238fc50 req-922b7ee2-da45-4057-bca0-43b86ca2caff tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0505924 Nov 24 16:12:46.846019 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-92b60573-8755-401f-b77b-daea1238fc50 req-5088a593-c679-4b14-a0b3-321328bff1ae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/security-groups?id=48b8a254-8580-4ea5-aa35-4dfce9b414ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409439 Nov 24 16:12:47.423999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b0a679-314a-411c-a73a-1537f97b7572 req-29d195c7-b089-4896-91d4-f87e8148d7b8 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:12:47.425456 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-82b0a679-314a-411c-a73a-1537f97b7572 req-29d195c7-b089-4896-91d4-f87e8148d7b8 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.71 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 946 time: 0.0512323 Nov 24 16:12:47.516423 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Deleting port fe858985-c82e-488e-aceb-25ed4bffc8ee {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:47.516769 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:47.606859 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] For port fe858985-c82e-488e-aceb-25ed4bffc8ee, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=fe858985-c82e-488e-aceb-25ed4bffc8ee,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:47.607220 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:47.618746 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling delete_port for fe858985-c82e-488e-aceb-25ed4bffc8ee owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:47.755595 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:47.768343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['fe858985-c82e-488e-aceb-25ed4bffc8ee'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:12:47.789493 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Pushing event deleted for resources: {'Port': ['ID=fe858985-c82e-488e-aceb-25ed4bffc8ee,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:47.819580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.820215 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.820348 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.820579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.820907 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.821267 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.821596 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.821924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.822276 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.822598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.822919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.823265 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:12:47.843169 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] No DVR routers for this DVR port fe858985-c82e-488e-aceb-25ed4bffc8ee on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:12:47.845571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:47.848896 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-82b0a679-314a-411c-a73a-1537f97b7572 req-b05f7532-871a-445e-9d4e-8cefd3957491 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.71 "DELETE /v2.0/ports/fe858985-c82e-488e-aceb-25ed4bffc8ee HTTP/1.1" status: 204 len: 173 time: 0.4167223 Nov 24 16:12:47.849371 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'name': 'network-vif-deleted', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:12:47.851667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7d276c2-9d2a-4173-a3bf-5dd942b06310" -d '{"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-deleted", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:12:47.904430 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:12:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77106041-a431-4208-889a-44e0f15ada24 x-openstack-request-id: req-77106041-a431-4208-889a-44e0f15ada24 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:12:47.904939 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-deleted", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:12:47.905517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-77106041-a431-4208-889a-44e0f15ada24 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:12:47.906084 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47f17e69-ba46-4a11-8bfb-01e444817ac1', 'name': 'network-vif-deleted', 'tag': 'fe858985-c82e-488e-aceb-25ed4bffc8ee', 'status': 'completed', 'code': 200} Nov 24 16:12:47.977240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f req-a78fe132-5d82-4882-9fc3-d53a482892d5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /v2.0/ports?device_id=47f17e69-ba46-4a11-8bfb-01e444817ac1 HTTP/1.1" status: 200 len: 210 time: 0.0281518 Nov 24 16:12:48.604183 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-424c9c43-21dc-435a-8621-4d7555c6efb0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:49.739034 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38788) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:50.328017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:50.624783 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Deleting port c7604272-2019-4eb1-b9f5-030ba5c460ea {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:50.625049 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:50.703719 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] For port c7604272-2019-4eb1-b9f5-030ba5c460ea, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c7604272-2019-4eb1-b9f5-030ba5c460ea,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:50.704099 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:50.717250 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Calling delete_port for c7604272-2019-4eb1-b9f5-030ba5c460ea owned by network:router_interface {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:50.811902 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device fe858985-c82e-488e-aceb-25ed4bffc8ee no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:50.836129 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: fe858985-c82e-488e-aceb-25ed4bffc8ee {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:50.836477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device fe858985-c82e-488e-aceb-25ed4bffc8ee not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:51.171514 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:51.199149 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=c7604272-2019-4eb1-b9f5-030ba5c460ea,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:51.274907 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-dd3ee284-9be7-4b3d-ac70-410e384490a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:51.387426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:51.612282 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Router 6b4ede60-92bd-4670-939a-9a888194c526 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:51.720369 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:51.726905 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-32e382d0-d49f-47c3-a80b-5c81667041e8 admin admin] 10.222.0.72 "PUT /v2.0/routers/6b4ede60-92bd-4670-939a-9a888194c526/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9855134 Nov 24 16:12:51.728919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38800) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:51.730922 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Sync routers for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:51.741841 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:51.742550 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:51.838860 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks [] for router, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:51.851545 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:51.945673 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.004825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Deleting port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:52.005207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.037232 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66'}], 'enable_snat': True}, 'gw_port_id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:12:51Z', 'revision_number': 5, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port': {'id': '14bf6abc-9e62-4e60-9593-4ad5c8c6e399', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:6e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b4ede60-92bd-4670-939a-9a888194c526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:46Z', 'updated_at': '2021-11-24T16:07:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:52.068456 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Checking router: 6b4ede60-92bd-4670-939a-9a888194c526 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:52.077637 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Routers {'6b4ede60-92bd-4670-939a-9a888194c526'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:52.078269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['6b4ede60-92bd-4670-939a-9a888194c526'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:52.113057 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] For port 14bf6abc-9e62-4e60-9593-4ad5c8c6e399, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:52.113378 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.127013 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Calling delete_port for 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 owned by network:router_gateway {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:52.169007 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] Set router 6b4ede60-92bd-4670-939a-9a888194c526 gateway port host: None {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:52.224726 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:12:51Z', 'revision_number': 6, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:52.253250 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e544d91-a4e5-41b0-8ec3-eae482aedda9 None None] The sync data for ids ['6b4ede60-92bd-4670-939a-9a888194c526'] in dv-cinder-818994-2-iscsi is: [{'id': '6b4ede60-92bd-4670-939a-9a888194c526', 'name': 'tempest-TestMinimumBasicScenario-1055956853-router', 'tenant_id': '3b09c1b1b2994015967d00aba299005b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:45Z', 'updated_at': '2021-11-24T16:12:51Z', 'revision_number': 6, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'gw_port_host': None}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:52.305602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.337063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Pushing event deleted for resources: {'Port': ['ID=14bf6abc-9e62-4e60-9593-4ad5c8c6e399,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:52.395061 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.508448 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.513021 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.582492 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.583066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6b4ede60-92bd-4670-939a-9a888194c526 {{(pid=102788) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:12:52.588128 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.592315 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5da3e99d-0b6e-460e-b86a-b59ba225c7a9 admin admin] 10.222.0.72 "DELETE /v2.0/routers/6b4ede60-92bd-4670-939a-9a888194c526 HTTP/1.1" status: 204 len: 168 time: 0.8590927 Nov 24 16:12:52.592537 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38806) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:52.646508 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Deleting subnet 639f9430-29e6-4689-9e38-afdda9766d8e {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:12:52.650309 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.652477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.693399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30444690'] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.803180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.866311 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29518436', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29486226'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.893449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=639f9430-29e6-4689-9e38-afdda9766d8e,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:52.897972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:52.901398 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-30c200a0-a42e-4962-860e-8c5f057fa640 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/639f9430-29e6-4689-9e38-afdda9766d8e HTTP/1.1" status: 204 len: 168 time: 0.3077035 Nov 24 16:12:52.904141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38808) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:52.907559 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21dad886-0bda-4dde-8203-0a2d3e9a2f21 None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:12:53.023822 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.116294 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Deleting port 4080d5b5-d627-42a7-b0e9-25fa22fac195 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:53.116789 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.152113 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c7604272-2019-4eb1-b9f5-030ba5c460ea no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:53.186778 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] DHCP port deletion for 5bfa1501-ec44-4dcf-b786-02db2672e4a7 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:12:53.189785 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: c7604272-2019-4eb1-b9f5-030ba5c460ea {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:53.190207 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c7604272-2019-4eb1-b9f5-030ba5c460ea not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:53.190682 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:53.208317 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] For port 4080d5b5-d627-42a7-b0e9-25fa22fac195, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4080d5b5-d627-42a7-b0e9-25fa22fac195,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:53.208791 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.217060 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:53.217608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 14bf6abc-9e62-4e60-9593-4ad5c8c6e399 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:53.228875 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Calling delete_port for 4080d5b5-d627-42a7-b0e9-25fa22fac195 owned by network:dhcp {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:53.266792 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Deleting port 4080d5b5-d627-42a7-b0e9-25fa22fac195 {{(pid=102789) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:53.267171 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.344424 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.364611 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] For port 4080d5b5-d627-42a7-b0e9-25fa22fac195, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=4080d5b5-d627-42a7-b0e9-25fa22fac195,segment=NetworkSegment(f8c02baf-f798-42ce-a13d-1280c21c3434),segment_id=f8c02baf-f798-42ce-a13d-1280c21c3434)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:53.365424 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.404330 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Pushing event deleted for resources: {'Port': ['ID=4080d5b5-d627-42a7-b0e9-25fa22fac195,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:53.407572 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] No DVR routers for this DVR port 4080d5b5-d627-42a7-b0e9-25fa22fac195 on host dv-cinder-818994-2-iscsi {{(pid=102787) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:12:53.491519 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.523840 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5bfa1501-ec44-4dcf-b786-02db2672e4a7']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:53.526120 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Calling delete_port for 4080d5b5-d627-42a7-b0e9-25fa22fac195 owned by network:dhcp {{(pid=102789) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:53.535623 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f8c02baf-f798-42ce-a13d-1280c21c3434') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:53.535922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f8c02baf-f798-42ce-a13d-1280c21c3434') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:53.551371 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.568402 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.577667 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Releasing vlan 1048 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:12:53.578163 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:12:53.579935 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:12:53.652320 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.659384 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.663308 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] 10.222.0.72 "DELETE /v2.0/networks/5bfa1501-ec44-4dcf-b786-02db2672e4a7 HTTP/1.1" status: 204 len: 168 time: 0.7578173 Nov 24 16:12:53.668612 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38814) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:53.682332 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81babd54-9dd2-40ae-b819-b48adc206023 admin admin] Pushing event deleted for resources: {'Network': ['ID=5bfa1501-ec44-4dcf-b786-02db2672e4a7,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:53.690663 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:53.730286 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Network 5bfa1501-ec44-4dcf-b786-02db2672e4a7 is not hosted by any dhcp agent {{(pid=102789) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 16:12:53.731037 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] No DVR routers for this DVR port 4080d5b5-d627-42a7-b0e9-25fa22fac195 on host dv-cinder-818994-2-iscsi {{(pid=102789) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:12:53.733452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5c0b72-b0c2-4683-8333-f5a4f5c0a40f None None] Pushing event deleted for resources: {'Port': ['ID=4080d5b5-d627-42a7-b0e9-25fa22fac195,revision_number=None']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:54.074093 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.328315 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.364111 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Deleting port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:54.364447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.449743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] For port e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:54.450143 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.463175 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Calling delete_port for e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f owned by network:router_interface {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:54.470283 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.651776 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:54.678054 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Pushing event deleted for resources: {'Port': ['ID=e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:54.859135 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:55.093014 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Router c7f99318-c2d6-486a-b218-d9f85c2f211c has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:12:55.155808 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4080d5b5-d627-42a7-b0e9-25fa22fac195 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:55.185836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 4080d5b5-d627-42a7-b0e9-25fa22fac195 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:55.185836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 4080d5b5-d627-42a7-b0e9-25fa22fac195 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:55.215315 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:12:55.220489 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e2ea1de0-a859-4448-9750-17e21a64886f admin admin] 10.222.0.72 "PUT /v2.0/routers/c7f99318-c2d6-486a-b218-d9f85c2f211c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5503895 Nov 24 16:12:55.224100 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Sync routers for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:12:55.225325 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38820) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:55.237297 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:55.237931 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:55.355646 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:55.575942 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:12:54Z', 'revision_number': 5, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:55.604411 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Checking router: c7f99318-c2d6-486a-b218-d9f85c2f211c for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:12:55.610215 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks [] for router, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:55.614417 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Routers {'c7f99318-c2d6-486a-b218-d9f85c2f211c'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:12:55.615050 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:12:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['c7f99318-c2d6-486a-b218-d9f85c2f211c'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:55.724907 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:55.756837 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] Set router c7f99318-c2d6-486a-b218-d9f85c2f211c gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:12:55.783948 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Deleting port 47711002-6eb0-4310-9bbf-38ec3196de91 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:55.784279 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:55.876368 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] For port 47711002-6eb0-4310-9bbf-38ec3196de91, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=47711002-6eb0-4310-9bbf-38ec3196de91,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:55.876368 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:55.891541 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Calling delete_port for 47711002-6eb0-4310-9bbf-38ec3196de91 owned by network:router_gateway {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:56.073875 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.095607 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:12:54Z', 'revision_number': 5, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:56.121490 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Pushing event deleted for resources: {'Port': ['ID=47711002-6eb0-4310-9bbf-38ec3196de91,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:56.129580 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbde7c59-eaa5-4ac6-85f3-4986b63dee2c None None] The sync data for ids ['c7f99318-c2d6-486a-b218-d9f85c2f211c'] in dv-cinder-818994-2-iscsi is: [{'id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'name': 'tempest-TestMinimumBasicScenario-1533739057-router', 'tenant_id': '931febe58cd44954b13dcb5b47841624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:07:54Z', 'updated_at': '2021-11-24T16:12:54Z', 'revision_number': 5, 'project_id': '931febe58cd44954b13dcb5b47841624', 'gw_port': {'id': '47711002-6eb0-4310-9bbf-38ec3196de91', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:93:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f99318-c2d6-486a-b218-d9f85c2f211c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:07:55Z', 'updated_at': '2021-11-24T16:08:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:12:56.212558 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.356875 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.359219 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.410878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.411595 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Fanout notify agent at l3_agent the message router_deleted on router c7f99318-c2d6-486a-b218-d9f85c2f211c {{(pid=102788) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:12:56.419626 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.420993 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-39cde202-94ae-484e-81df-b4b6ffbafc8e admin admin] 10.222.0.72 "DELETE /v2.0/routers/c7f99318-c2d6-486a-b218-d9f85c2f211c HTTP/1.1" status: 204 len: 168 time: 1.1944790 Nov 24 16:12:56.423555 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38826) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:56.471752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Deleting subnet d1ef0457-5a2b-4ce2-ade0-e40400c004c8 {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:12:56.476500 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.543416 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30444690'] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.648550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.720629 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29518436', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29486226'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.755302 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d1ef0457-5a2b-4ce2-ade0-e40400c004c8,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:56.759681 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.767330 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-03b683a3-ce2e-4175-8020-32cb67d4b400 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/d1ef0457-5a2b-4ce2-ade0-e40400c004c8 HTTP/1.1" status: 204 len: 168 time: 0.3392169 Nov 24 16:12:56.768175 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 38830) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:56.773066 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43de2af7-164b-4ec3-9507-a7e4874e9f3e None None] Network 6f3d5341-c722-4cef-961d-6f0a15c8ff92 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:12:56.874366 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:56.944688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Deleting port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:12:56.945008 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.018674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] For port 0738bc1d-57dd-4608-80db-65d4c8cf95b7, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=0738bc1d-57dd-4608-80db-65d4c8cf95b7,segment=NetworkSegment(b0c82001-5cda-4e61-adb0-5386e8d7fe18),segment_id=b0c82001-5cda-4e61-adb0-5386e8d7fe18)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:12:57.019245 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.042490 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Calling delete_port for 0738bc1d-57dd-4608-80db-65d4c8cf95b7 owned by network:dhcp {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:12:57.135509 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.161682 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Pushing event deleted for resources: {'Port': ['ID=0738bc1d-57dd-4608-80db-65d4c8cf95b7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:57.165585 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] No DVR routers for this DVR port 0738bc1d-57dd-4608-80db-65d4c8cf95b7 on host dv-cinder-818994-2-iscsi {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:12:57.248340 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.269653 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f3d5341-c722-4cef-961d-6f0a15c8ff92']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:57.282738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b0c82001-5cda-4e61-adb0-5386e8d7fe18') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:57.283042 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b0c82001-5cda-4e61-adb0-5386e8d7fe18') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:12:57.296397 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.305603 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2bcf34b-d6e5-4d01-bd74-48a5e3c50a51 None None] DHCP port deletion for 6f3d5341-c722-4cef-961d-6f0a15c8ff92 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:12:57.314206 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.328742 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Releasing vlan 1011 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:12:57.329194 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:12:57.331154 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:12:57.381698 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 0738bc1d-57dd-4608-80db-65d4c8cf95b7 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:57.396704 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.406488 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.409666 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 0738bc1d-57dd-4608-80db-65d4c8cf95b7 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:57.410464 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 0738bc1d-57dd-4608-80db-65d4c8cf95b7 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:57.410464 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:57.412963 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] 10.222.0.72 "DELETE /v2.0/networks/6f3d5341-c722-4cef-961d-6f0a15c8ff92 HTTP/1.1" status: 204 len: 168 time: 0.6438215 Nov 24 16:12:57.430935 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235d7401-f925-4f48-904c-f610195b2350 admin admin] Pushing event deleted for resources: {'Network': ['ID=6f3d5341-c722-4cef-961d-6f0a15c8ff92,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:57.431366 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:57.431719 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device e9c4aeb1-f5aa-4ad6-9aa6-4398b7e50d2f not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:57.432176 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 47711002-6eb0-4310-9bbf-38ec3196de91 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:12:57.453182 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 47711002-6eb0-4310-9bbf-38ec3196de91 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:12:57.453538 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 47711002-6eb0-4310-9bbf-38ec3196de91 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:12:57.532814 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38836) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:57.574536 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f1c698d9-e2d3-4421-9ba6-97f4da5c387e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3b09c1b1b2994015967d00aba299005b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0405011 Nov 24 16:12:57.578761 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38838) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:57.628380 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.650329 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.706971 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.710461 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:57.712876 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/48b8a254-8580-4ea5-aa35-4dfce9b414ab HTTP/1.1" status: 204 len: 168 time: 0.1326373 Nov 24 16:12:57.722994 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37cb78bd-de48-4cbf-9ff8-f5b7d4a21eac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48b8a254-8580-4ea5-aa35-4dfce9b414ab,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:12:58.110778 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38848) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:58.154069 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6c53baf9-27a3-4208-b716-bbbd146945e4 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=931febe58cd44954b13dcb5b47841624&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0419631 Nov 24 16:12:58.156580 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 38850) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:12:58.207333 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:58.230888 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:58.280401 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:58.283280 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:12:58.284457 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a0181b05-7f50-4cde-ba30-2e0a12ad539f HTTP/1.1" status: 204 len: 168 time: 0.1269133 Nov 24 16:12:58.293902 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ca72483-20f3-4ccd-a8cd-c78d1ea72f56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0181b05-7f50-4cde-ba30-2e0a12ad539f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:13:14.254583 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:17.477127 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-9fc4810b-68b3-4f06-a67a-e2cef0b5f6dc service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0475943 Nov 24 16:13:17.582329 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0052bf44-1f9e-459a-be24-ba430247293f req-a3a4fbdb-2f12-480b-9a08-636684e3b1fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:17.584174 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-a3a4fbdb-2f12-480b-9a08-636684e3b1fb service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1098 time: 0.0482907 Nov 24 16:13:17.692961 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0052bf44-1f9e-459a-be24-ba430247293f req-19b94e13-7c8e-4012-8fe0-9248e2cbab25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:17.694362 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-19b94e13-7c8e-4012-8fe0-9248e2cbab25 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0888109 Nov 24 16:13:17.762100 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-4f9efcb0-eb64-4807-bf55-c09aeaed3f0f service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 1001 time: 0.0588760 Nov 24 16:13:17.812736 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0052bf44-1f9e-459a-be24-ba430247293f req-4c5c0c12-41e7-4bf1-b117-680c0fa29e1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:17.814217 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-4c5c0c12-41e7-4bf1-b117-680c0fa29e1b service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0430362 Nov 24 16:13:17.865211 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0052bf44-1f9e-459a-be24-ba430247293f req-1a74841b-c26e-4a64-b650-eba850e45e92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:17.866695 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-1a74841b-c26e-4a64-b650-eba850e45e92 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435121 Nov 24 16:13:17.956553 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-f85d1669-0872-4ed5-abf8-1b4660509870 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813594 Nov 24 16:13:18.049051 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0052bf44-1f9e-459a-be24-ba430247293f req-0736428a-4409-424d-9312-d773b70335f3 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849843 Nov 24 16:13:18.607120 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c5496f62-5b7f-4d8f-a9c0-88729eb26d4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:19.000757 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:13:21.266763 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b570e5d4-336a-4e6b-af9b-4e59d3a4e4cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:22.650418 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:24.322809 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:24.473438 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:25.849009 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59a2036-f937-4801-84f9-e478d338a148 req-20152c03-2ee3-4dca-9ceb-0061d5b6d224 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:25.850545 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d59a2036-f937-4801-84f9-e478d338a148 req-20152c03-2ee3-4dca-9ceb-0061d5b6d224 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0492845 Nov 24 16:13:25.897994 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d59a2036-f937-4801-84f9-e478d338a148 req-2b556981-5abe-4cf9-8091-4cc1d32b7172 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407982 Nov 24 16:13:27.022918 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf69759-960c-4bab-a607-13e5345233cf req-97095990-58cf-416d-945b-53a303941a73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:27.024395 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8bf69759-960c-4bab-a607-13e5345233cf req-97095990-58cf-416d-945b-53a303941a73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0525916 Nov 24 16:13:27.071350 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8bf69759-960c-4bab-a607-13e5345233cf req-403fe2b5-7159-4098-a4b3-d0ad2a021552 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409999 Nov 24 16:13:28.194214 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f req-70a482e3-e7a0-450c-881c-0069e61a3b57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:28.195701 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f req-70a482e3-e7a0-450c-881c-0069e61a3b57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0491314 Nov 24 16:13:28.245847 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f req-656e4635-8655-4928-91cb-daaf38add3a6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432737 Nov 24 16:13:29.369044 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f009b6-4417-475d-8047-1585d20e4f1e req-652c69a5-8e3c-4073-b5fb-1b620799ceb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:29.370457 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-04f009b6-4417-475d-8047-1585d20e4f1e req-652c69a5-8e3c-4073-b5fb-1b620799ceb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0503781 Nov 24 16:13:29.422876 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-04f009b6-4417-475d-8047-1585d20e4f1e req-c499a78b-0f1d-4995-a9c0-f6646a2b3eca tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462573 Nov 24 16:13:30.544405 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3aa91b1-e306-4a81-ba7d-db74058868c0 req-d22f09b6-799e-49af-8147-5542c44e6c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:30.545972 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d3aa91b1-e306-4a81-ba7d-db74058868c0 req-d22f09b6-799e-49af-8147-5542c44e6c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0502760 Nov 24 16:13:30.592742 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d3aa91b1-e306-4a81-ba7d-db74058868c0 req-83671124-8816-4bf3-a968-e5e7617ebc9f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408616 Nov 24 16:13:31.710585 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5752f441-7284-4744-ab45-c9f5502636e5 req-b5ad3c62-2b44-4f86-a6a8-b8d2d307ff10 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:31.712067 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5752f441-7284-4744-ab45-c9f5502636e5 req-b5ad3c62-2b44-4f86-a6a8-b8d2d307ff10 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0485744 Nov 24 16:13:31.758942 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5752f441-7284-4744-ab45-c9f5502636e5 req-22d0a470-8c5a-4475-bb3a-951a3058717f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409715 Nov 24 16:13:32.881306 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f req-f20ae9d0-5ad4-4147-a131-4aa03b6b46cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:32.882715 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f req-f20ae9d0-5ad4-4147-a131-4aa03b6b46cb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0516939 Nov 24 16:13:32.930168 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f req-ed531b36-68d7-48da-829b-f7baa287dee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415366 Nov 24 16:13:34.051695 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e45e50-be99-4609-a276-299cc2d0a937 req-36981293-1e3e-4761-af2d-4aeb3341d047 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:34.053190 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a3e45e50-be99-4609-a276-299cc2d0a937 req-36981293-1e3e-4761-af2d-4aeb3341d047 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0487101 Nov 24 16:13:34.099307 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a3e45e50-be99-4609-a276-299cc2d0a937 req-301de6b6-ec72-4010-98b1-be57cf0ae65c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402753 Nov 24 16:13:35.219912 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306367c7-881b-4016-882c-ae052c414425 req-a243c40b-4ece-4f10-96fb-1e62cc49f33b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:35.221408 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-306367c7-881b-4016-882c-ae052c414425 req-a243c40b-4ece-4f10-96fb-1e62cc49f33b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0510261 Nov 24 16:13:35.273578 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-306367c7-881b-4016-882c-ae052c414425 req-8d56a48b-c17b-4e06-8664-e20d403a8176 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461895 Nov 24 16:13:36.392541 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d51cc82-0192-4e8b-9984-829a0c092ee9 req-dc686573-daaf-48cb-b7fb-9640a4086498 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:36.394048 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8d51cc82-0192-4e8b-9984-829a0c092ee9 req-dc686573-daaf-48cb-b7fb-9640a4086498 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0478911 Nov 24 16:13:36.440340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8d51cc82-0192-4e8b-9984-829a0c092ee9 req-85695cf1-4718-47b3-b055-b7d1438cffab tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404093 Nov 24 16:13:37.578850 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8749014-3f4b-4d1e-af37-8af7e466b900 req-b70edd41-7377-4194-848d-9814b5cd09b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:37.580540 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a8749014-3f4b-4d1e-af37-8af7e466b900 req-b70edd41-7377-4194-848d-9814b5cd09b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0608065 Nov 24 16:13:37.638323 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a8749014-3f4b-4d1e-af37-8af7e466b900 req-30acdb65-776a-43e7-813e-54526280d28b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509791 Nov 24 16:13:38.761346 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 req-dcc07a63-b062-4c0d-9c88-cdf2ba81436b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:38.763117 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 req-dcc07a63-b062-4c0d-9c88-cdf2ba81436b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0532761 Nov 24 16:13:38.811099 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 req-ed64a985-18b4-4704-ad5f-63fe7f29c83a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421939 Nov 24 16:13:39.015242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:13:39.110910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:13:39.121734 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:13:39.159408 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:39.173296 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:13:39.195016 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:13:39.199703 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:39.255052 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=6']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:13:39.262428 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.262808 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.263161 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.263504 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.263840 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.264176 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.264523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.264867 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.265237 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.265620 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.265898 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.266223 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:13:39.276105 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:13:39.929051 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffef7121-4592-4b4b-ba62-75658d4aad66 req-280c644c-276f-47b3-b013-0715fca5903b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:39.930522 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffef7121-4592-4b4b-ba62-75658d4aad66 req-280c644c-276f-47b3-b013-0715fca5903b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 944 time: 0.0485616 Nov 24 16:13:39.977168 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffef7121-4592-4b4b-ba62-75658d4aad66 req-dfe02820-3be6-4f07-a148-bd64ddfd641a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407395 Nov 24 16:13:41.023024 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:13:41.074359 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:13:41.074712 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:41.103855 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed req-d66ca286-741a-4f74-b586-ed571441bbef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:41.105411 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed req-d66ca286-741a-4f74-b586-ed571441bbef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 944 time: 0.0527694 Nov 24 16:13:41.150437 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:41.153164 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed req-ac522c4c-5b58-4729-931b-12417eacabaf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407779 Nov 24 16:13:41.174047 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:13:41.176356 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59b6d5af-ed19-4662-ace5-b8711eb86330" -d '{"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:13:41.188924 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:13:41.193000 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:41.220622 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:13:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8198aa76-19af-48b6-a13c-30dc44ef314e x-openstack-request-id: req-8198aa76-19af-48b6-a13c-30dc44ef314e {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:13:41.220936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:13:41.221213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8198aa76-19af-48b6-a13c-30dc44ef314e {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:13:41.221596 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'code': 200} Nov 24 16:13:41.246345 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=7']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:13:42.274761 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3032a2fb-4056-4b51-9710-5244b282fd63 req-e5c66ed4-e6a2-4fa2-a261-9b4e50927d78 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:42.276241 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3032a2fb-4056-4b51-9710-5244b282fd63 req-e5c66ed4-e6a2-4fa2-a261-9b4e50927d78 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0494883 Nov 24 16:13:42.327406 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3032a2fb-4056-4b51-9710-5244b282fd63 req-18dd90ca-b7f9-4bfa-90d8-224cf03b120f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447335 Nov 24 16:13:43.458646 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b28d5e8-c66c-4519-8819-a17e01762071 req-bb90a006-d41d-4456-ae52-a82c3a7d0968 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:43.466755 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6b28d5e8-c66c-4519-8819-a17e01762071 req-bb90a006-d41d-4456-ae52-a82c3a7d0968 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0572155 Nov 24 16:13:43.524890 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6b28d5e8-c66c-4519-8819-a17e01762071 req-7e19aade-f7fd-4f5d-8b1d-dbeb7e752bdc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0569918 Nov 24 16:13:44.245331 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:44.657253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b38e30de-29dd-4fee-a34a-aec408b72f57 req-73b90ac3-3c4b-4103-84ef-d5eff6c9fc9e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:44.659498 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b38e30de-29dd-4fee-a34a-aec408b72f57 req-73b90ac3-3c4b-4103-84ef-d5eff6c9fc9e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0564194 Nov 24 16:13:44.720017 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b38e30de-29dd-4fee-a34a-aec408b72f57 req-fe57dc0d-7718-4c4c-8877-0dc93c1b5be9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501735 Nov 24 16:13:45.880026 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95698a0-fdef-4759-b5e9-9267fc477a7e req-bd20891c-a904-46a6-a299-df97a73af5b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:45.881615 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f95698a0-fdef-4759-b5e9-9267fc477a7e req-bd20891c-a904-46a6-a299-df97a73af5b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0588067 Nov 24 16:13:45.950622 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f95698a0-fdef-4759-b5e9-9267fc477a7e req-6cde0f7a-7038-4174-9061-29332903191c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582464 Nov 24 16:13:47.088165 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 req-393706b8-ef08-4482-8b8d-858200d9148a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:47.089720 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 req-393706b8-ef08-4482-8b8d-858200d9148a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0528576 Nov 24 16:13:47.143166 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 req-3756339a-b8f3-43ed-8633-a72faaecb5c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458496 Nov 24 16:13:48.286942 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d2f07e3-b932-449e-8fbc-cd942138b93a req-1cdf65c1-1ce2-4a73-96bc-c60345027db0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:48.289709 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8d2f07e3-b932-449e-8fbc-cd942138b93a req-1cdf65c1-1ce2-4a73-96bc-c60345027db0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0580740 Nov 24 16:13:48.357564 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8d2f07e3-b932-449e-8fbc-cd942138b93a req-44134b3c-04af-4815-8058-29ecc78f0843 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606999 Nov 24 16:13:48.614355 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f92dbc50-7c63-4c37-8317-dce74c1cdb50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:49.493899 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f33a34e-88e0-4231-834a-a0769f21faa7 req-31862d8b-758a-40d3-ab02-3d9af0a4cb3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:49.495803 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4f33a34e-88e0-4231-834a-a0769f21faa7 req-31862d8b-758a-40d3-ab02-3d9af0a4cb3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0568202 Nov 24 16:13:49.550430 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4f33a34e-88e0-4231-834a-a0769f21faa7 req-06ae405c-5607-41ef-b511-316e802a6b1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481739 Nov 24 16:13:50.691893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0240720-18f7-4699-897b-278169fa85e9 req-f1076802-6b05-4221-a0e0-1c005e29f49a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:50.694629 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a0240720-18f7-4699-897b-278169fa85e9 req-f1076802-6b05-4221-a0e0-1c005e29f49a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0521877 Nov 24 16:13:50.747345 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-a0240720-18f7-4699-897b-278169fa85e9 req-5dd82e5a-fc3d-4a49-a8a0-8e810b8a887f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458009 Nov 24 16:13:51.291824 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a3f7a106-b63a-4dac-98c5-d1c5e1abb35d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:51.900603 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f424ce5-5dd0-4115-92db-e366ffa3da74 req-cccdd920-226f-4598-bceb-dc74fe14ce51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:51.902096 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f424ce5-5dd0-4115-92db-e366ffa3da74 req-cccdd920-226f-4598-bceb-dc74fe14ce51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0574656 Nov 24 16:13:51.966227 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3f424ce5-5dd0-4115-92db-e366ffa3da74 req-3999052c-7a44-4dd1-8888-b9f88bb13550 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0564322 Nov 24 16:13:52.653215 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:53.098426 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9e29dc-5cea-4d10-89fd-4f729227a87e req-b71cf255-a455-4e0b-a83b-18a01170a2d5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:53.099939 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c9e29dc-5cea-4d10-89fd-4f729227a87e req-b71cf255-a455-4e0b-a83b-18a01170a2d5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0509653 Nov 24 16:13:53.148660 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9c9e29dc-5cea-4d10-89fd-4f729227a87e req-75b2362f-9ef8-4fe9-aa1b-36ac779f9fcc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425227 Nov 24 16:13:53.205167 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-4fb8e12d-3ba4-4a8e-ad89-82f5332bf901 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:53.206687 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-4fb8e12d-3ba4-4a8e-ad89-82f5332bf901 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1098 time: 0.0407338 Nov 24 16:13:53.311941 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-291c3499-b464-481a-bede-de9b0df719cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:53.314110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-291c3499-b464-481a-bede-de9b0df719cd service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0996749 Nov 24 16:13:53.380526 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-759dcc9c-0db6-48c7-ac70-dc4ee9f2a083 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 1001 time: 0.0593438 Nov 24 16:13:53.430408 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-e7d0e8c6-0746-466f-867b-824a70340cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:53.431835 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-e7d0e8c6-0746-466f-867b-824a70340cd6 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0443289 Nov 24 16:13:53.481862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-3c49c2d7-238e-4448-8d98-21fa66e5d4a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:53.483343 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-3c49c2d7-238e-4448-8d98-21fa66e5d4a2 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0443859 Nov 24 16:13:53.576692 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-cdff6c7e-5bd8-45f5-b046-e00eb692404e service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859060 Nov 24 16:13:53.679214 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f15c598-2efd-4392-a0ea-d94dcfb48989 req-7b8bbc46-d6c0-466e-b79e-35ac36fdd926 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950000 Nov 24 16:13:54.278792 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 req-061df8bd-17b7-4d64-8478-1fd1bde0a3ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:54.280318 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 req-061df8bd-17b7-4d64-8478-1fd1bde0a3ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0579131 Nov 24 16:13:54.325443 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:54.333067 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 req-ba7c346a-da09-41ab-a21b-9fd7ceb80a21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461781 Nov 24 16:13:54.478094 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:55.460578 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1700b8fd-8d07-4443-a63f-350a1adf7964 req-e8ead524-c4f6-4e36-914f-1bb7508b4fad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:55.462127 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1700b8fd-8d07-4443-a63f-350a1adf7964 req-e8ead524-c4f6-4e36-914f-1bb7508b4fad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0529735 Nov 24 16:13:55.516150 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1700b8fd-8d07-4443-a63f-350a1adf7964 req-835182cf-c6a7-49da-917c-f0bc237ffd19 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478420 Nov 24 16:13:56.000495 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:13:56.640106 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b req-f74d7fc3-336f-4d1a-9440-fc9123d37e12 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:56.642084 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b req-f74d7fc3-336f-4d1a-9440-fc9123d37e12 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 945 time: 0.0493195 Nov 24 16:13:56.693703 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b req-eee27451-919a-4800-8426-49d92455fa78 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456998 Nov 24 16:13:57.101924 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:13:57.184788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:57.209496 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:13:57.211585 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b95da2c4-146f-4dc4-a72a-adae8c18db14" -d '{"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-unplugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:13:57.225235 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:13:57.229619 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:13:57.257455 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 24 Nov 2021 16:13:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d180110a-99e8-46c0-81a7-a558f8a868c9 x-openstack-request-id: req-d180110a-99e8-46c0-81a7-a558f8a868c9 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:13:57.257750 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-unplugged", "status": "failed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "code": 422}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:13:57.258008 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-d180110a-99e8-46c0-81a7-a558f8a868c9 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:13:57.258394 dv-cinder-818994-2-iscsi neutron-server[102789]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'code': 422} returned with failed status Nov 24 16:13:57.286119 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=8']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:13:57.463841 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-4ddf34e4-28c0-4de9-ab95-17855d8b8e76 req-c4154150-804d-43da-8d06-f99de5166bc0 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:13:57.464921 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ddf34e4-28c0-4de9-ab95-17855d8b8e76 req-c4154150-804d-43da-8d06-f99de5166bc0 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058148 Nov 24 16:13:57.629879 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f req-c6d2e648-95c7-458f-a036-036223d363d8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:57.631460 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f req-c6d2e648-95c7-458f-a036-036223d363d8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0539231 Nov 24 16:13:57.683606 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f req-76ade874-210b-497a-af17-2021684a4be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462627 Nov 24 16:13:57.955750 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39186) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:13:58.045712 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-dfcd1b7f-9445-45e2-8409-1e645b8d01e7 service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0887232 Nov 24 16:13:58.054722 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-4922ad61-e082-46f9-af83-8620338764c9 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:13:58.055736 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-4922ad61-e082-46f9-af83-8620338764c9 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050747 Nov 24 16:13:58.813295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d req-2064a265-179d-43e1-a45d-674c26f13f2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:58.814778 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d req-2064a265-179d-43e1-a45d-674c26f13f2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0514359 Nov 24 16:13:58.876303 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d req-3d597fbd-c9bd-4048-9756-c155c4dcbe36 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506785 Nov 24 16:13:58.921318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819b2c56-8b52-4657-bb19-523094e4341b req-5d0a8d08-73b8-4abf-a550-18227e46f32d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:58.923464 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-5d0a8d08-73b8-4abf-a550-18227e46f32d service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0&tenant_id=4ca913475fb04e7a8ea75d95578c8b84 HTTP/1.1" status: 200 len: 1096 time: 0.0438900 Nov 24 16:13:58.990546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819b2c56-8b52-4657-bb19-523094e4341b req-4fe874a1-f011-4547-8f8c-c9ab5e154f88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:58.992055 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-4fe874a1-f011-4547-8f8c-c9ab5e154f88 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1096 time: 0.0466969 Nov 24 16:13:59.086638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819b2c56-8b52-4657-bb19-523094e4341b req-1ab7dd03-0998-48ed-94e8-515db98da87a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:59.088156 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-1ab7dd03-0998-48ed-94e8-515db98da87a service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0894737 Nov 24 16:13:59.159620 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-6bfb4c62-f761-407e-bdd6-098cd72de122 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 999 time: 0.0645437 Nov 24 16:13:59.209512 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819b2c56-8b52-4657-bb19-523094e4341b req-fc1c53e9-c271-407c-9d33-3e0e80d7ee1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:59.210995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-fc1c53e9-c271-407c-9d33-3e0e80d7ee1c service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0449593 Nov 24 16:13:59.258382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819b2c56-8b52-4657-bb19-523094e4341b req-aa74840e-7566-41d8-bd6d-3b24ed8b6e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:13:59.259884 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-aa74840e-7566-41d8-bd6d-3b24ed8b6e8c service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420439 Nov 24 16:13:59.371848 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-48d3b4fd-ceed-47de-86de-2bc3d5c219b6 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1043379 Nov 24 16:13:59.492247 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-b7252780-6e32-49e3-8491-3e7a2da46f90 service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1121612 Nov 24 16:14:00.195424 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 req-f01df476-77d6-4dd6-a6b0-121c31182ba9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:00.210768 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 req-f01df476-77d6-4dd6-a6b0-121c31182ba9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.1226068 Nov 24 16:14:00.297753 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 req-10910862-e762-42fc-b294-69eaea63a1a5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0814502 Nov 24 16:14:01.428907 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3473db22-2d1d-4ccb-8f80-046bbddcd234 req-9bfd414e-fc83-404b-81b4-0dd24924c19d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:01.430423 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3473db22-2d1d-4ccb-8f80-046bbddcd234 req-9bfd414e-fc83-404b-81b4-0dd24924c19d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0493622 Nov 24 16:14:01.482077 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3473db22-2d1d-4ccb-8f80-046bbddcd234 req-b7f27e25-74bc-41c7-a4ec-f7b107df5103 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457211 Nov 24 16:14:02.607834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f5686e-c965-442c-a104-a2ad1eb484ea req-4923b583-aaa9-4bf1-8d7a-7c53221f9b66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:02.610041 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d6f5686e-c965-442c-a104-a2ad1eb484ea req-4923b583-aaa9-4bf1-8d7a-7c53221f9b66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0511048 Nov 24 16:14:02.663036 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d6f5686e-c965-442c-a104-a2ad1eb484ea req-a0c68531-90ab-4087-b0c1-87a50e7570ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455117 Nov 24 16:14:03.788397 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec req-ebd20228-b1c3-4c50-b280-2fa67f837b45 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:03.789931 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec req-ebd20228-b1c3-4c50-b280-2fa67f837b45 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0513639 Nov 24 16:14:03.844925 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec req-8d943510-5406-4863-9389-a80cd3aa6aac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489621 Nov 24 16:14:05.009707 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849b0c78-c304-4f9c-85e3-10cc30a24642 req-a3570160-fd71-4cf0-a63b-c444c13cbcf0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:05.011384 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-849b0c78-c304-4f9c-85e3-10cc30a24642 req-a3570160-fd71-4cf0-a63b-c444c13cbcf0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0523648 Nov 24 16:14:05.090058 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-849b0c78-c304-4f9c-85e3-10cc30a24642 req-b522e075-d45a-436e-9534-be9a770a4494 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0717535 Nov 24 16:14:06.253481 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c96f212-e377-4edf-824c-524fda4702fe req-9dd59395-24ae-4b71-9324-bf54c63ddab8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:06.255031 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7c96f212-e377-4edf-824c-524fda4702fe req-9dd59395-24ae-4b71-9324-bf54c63ddab8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0534599 Nov 24 16:14:06.329629 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7c96f212-e377-4edf-824c-524fda4702fe req-35a60528-6b16-43cf-ab1d-9d7a5cdcb3ce tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678823 Nov 24 16:14:07.491682 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef req-86e5e5a5-9033-480c-9805-5a320e7a5028 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:07.493837 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef req-86e5e5a5-9033-480c-9805-5a320e7a5028 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0613363 Nov 24 16:14:07.561664 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef req-cd425380-70cb-4863-9e3b-b36efe9cafec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609915 Nov 24 16:14:08.709962 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e56042-51e8-48b8-a837-e1904b80a4c8 req-611822fe-b021-4119-b5b9-dfc2ad21a0e4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:08.711768 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-40e56042-51e8-48b8-a837-e1904b80a4c8 req-611822fe-b021-4119-b5b9-dfc2ad21a0e4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0612888 Nov 24 16:14:08.784142 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-40e56042-51e8-48b8-a837-e1904b80a4c8 req-6fe0c063-ea69-4557-b8d6-8add6483507c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592268 Nov 24 16:14:09.932858 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f req-bfb76b1d-5ff6-4d88-83fa-6197fcc05b68 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:09.934427 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f req-bfb76b1d-5ff6-4d88-83fa-6197fcc05b68 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0689275 Nov 24 16:14:09.995552 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f req-af641b15-baf7-40e9-8501-4dd025169047 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0539560 Nov 24 16:14:11.138850 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d9d2cff-be00-4b5e-986b-e6d915213de1 req-cac937eb-be08-4315-80d2-5dba0f5fd834 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:11.140456 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7d9d2cff-be00-4b5e-986b-e6d915213de1 req-cac937eb-be08-4315-80d2-5dba0f5fd834 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0566728 Nov 24 16:14:11.194774 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7d9d2cff-be00-4b5e-986b-e6d915213de1 req-63b27be2-05fa-49ea-aac7-afbea671d51c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464876 Nov 24 16:14:12.324027 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74feb31-8c09-4f12-95ea-c268fac927c4 req-1280e23d-6e27-4154-bb57-a955d13714b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:12.325561 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b74feb31-8c09-4f12-95ea-c268fac927c4 req-1280e23d-6e27-4154-bb57-a955d13714b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0552189 Nov 24 16:14:12.376233 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b74feb31-8c09-4f12-95ea-c268fac927c4 req-b78ef19a-ca61-4d28-a5f1-f361c7aa86d0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447164 Nov 24 16:14:13.511408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec841cc-8cec-4bef-974d-cb7ad4a73974 req-bef80b55-3b68-49e2-9d80-adc876e1dcaf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:13.512990 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dec841cc-8cec-4bef-974d-cb7ad4a73974 req-bef80b55-3b68-49e2-9d80-adc876e1dcaf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0589032 Nov 24 16:14:13.568209 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dec841cc-8cec-4bef-974d-cb7ad4a73974 req-224406a5-eaf4-4f02-a232-05a77dc13523 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482407 Nov 24 16:14:14.255910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:14.696227 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fff2f0a-93e7-476b-b180-e7b82845924f req-7dd425d7-743e-4335-b327-666dd106d1cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:14.697762 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2fff2f0a-93e7-476b-b180-e7b82845924f req-7dd425d7-743e-4335-b327-666dd106d1cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0510914 Nov 24 16:14:14.747767 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2fff2f0a-93e7-476b-b180-e7b82845924f req-494af111-4a07-4d2f-8635-dc523596da80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427420 Nov 24 16:14:15.971922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa630110-220b-4e92-982d-fbc72defa54e req-b2d42666-138f-4ad9-8363-9ed5b4dde735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:15.973469 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-aa630110-220b-4e92-982d-fbc72defa54e req-b2d42666-138f-4ad9-8363-9ed5b4dde735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0581586 Nov 24 16:14:16.029303 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-aa630110-220b-4e92-982d-fbc72defa54e req-69f42935-63f0-4f9e-ad68-afabd0003eca tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493767 Nov 24 16:14:17.150377 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc req-83bc16d6-aa4c-4982-ac29-f06663f77c9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:17.151883 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc req-83bc16d6-aa4c-4982-ac29-f06663f77c9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 943 time: 0.0487437 Nov 24 16:14:17.204143 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc req-aee29b91-b361-41eb-bfe0-eda02763fd84 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458508 Nov 24 16:14:17.207274 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:14:17.303970 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:17.315602 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'port_id': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'mac_address': 'fa:16:3e:de:94:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1047, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:14:17.355560 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:17.369135 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:14:17.389148 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:17.393345 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:17.449553 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=9']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:17.723220 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:14:18.331193 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e214f5b-24e0-49b1-8cac-995438a0ef55 req-4c530ee9-c52a-4667-9cea-3f1c88673ee3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:18.332712 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e214f5b-24e0-49b1-8cac-995438a0ef55 req-4c530ee9-c52a-4667-9cea-3f1c88673ee3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 944 time: 0.0521810 Nov 24 16:14:18.388309 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e214f5b-24e0-49b1-8cac-995438a0ef55 req-9dcbfaa1-7594-46b9-ae1b-173979451bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461712 Nov 24 16:14:18.608036 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f5278269-62a6-4e45-be24-2e008a9418e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:18.905500 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-cef80de8-66b0-47a1-970c-14115418da1c service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0400231 Nov 24 16:14:18.971053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-a5e05681-4ec0-428c-904b-fc4020a48fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:18.972544 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-a5e05681-4ec0-428c-904b-fc4020a48fc6 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=1c341b845ae6468b847beba4eee796dd&device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 1098 time: 0.0407655 Nov 24 16:14:19.223373 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:14:19.282094 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:19.282653 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:19.365074 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-a74d5705-cca0-4cff-92c6-d11e73582303 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:19.366564 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-a74d5705-cca0-4cff-92c6-d11e73582303 service neutron] 10.222.0.71 "GET /v2.0/networks?id=d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 200 len: 913 time: 0.3740110 Nov 24 16:14:19.379390 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:19.402971 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:14:19.405260 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6" -d '{"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:14:19.420427 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:19.427793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:19.449310 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-babfa720-bac0-4a08-bd31-de3387b98646 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 200 len: 1001 time: 0.0750244 Nov 24 16:14:19.464004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:14:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d1409c8-eaf9-40e1-8076-1c29b89448ba x-openstack-request-id: req-9d1409c8-eaf9-40e1-8076-1c29b89448ba {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:14:19.464004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:14:19.464004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-9d1409c8-eaf9-40e1-8076-1c29b89448ba {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:14:19.464493 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'code': 200} Nov 24 16:14:19.493684 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=10']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:19.522117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-f119350c-d758-473b-a044-a04fcd99eda2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:19.523537 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-f119350c-d758-473b-a044-a04fcd99eda2 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 200 len: 850 time: 0.0668020 Nov 24 16:14:19.553133 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ada01f-9043-45b3-a160-f58856607a00 req-9dc6f4a7-85ad-46f7-95dc-c8cac6f800e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:19.556236 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-00ada01f-9043-45b3-a160-f58856607a00 req-9dc6f4a7-85ad-46f7-95dc-c8cac6f800e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0644135 Nov 24 16:14:19.583000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-313e45f9-31f8-4bc4-ace8-53270341eba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:19.584687 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-313e45f9-31f8-4bc4-ace8-53270341eba8 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=d785b693-1522-4c61-9c47-37993ec7d517&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0539911 Nov 24 16:14:19.621890 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-00ada01f-9043-45b3-a160-f58856607a00 req-5f772069-b8e7-4758-9fb1-2e77c8dbc521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0554609 Nov 24 16:14:19.712254 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-d4cc44bf-5f6f-4cfa-b0aa-1d8f21cbea66 service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1196082 Nov 24 16:14:19.732327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d92258-eae5-4a83-86fd-4ecc36ac26b6 req-e59e2e2d-477a-4448-b2c6-7c153da23abe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:19.733689 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2d92258-eae5-4a83-86fd-4ecc36ac26b6 req-e59e2e2d-477a-4448-b2c6-7c153da23abe service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1099 time: 0.0659904 Nov 24 16:14:19.835439 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2d92258-eae5-4a83-86fd-4ecc36ac26b6 req-581a93d0-b79c-4464-bb21-7857749a0b47 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0923204 Nov 24 16:14:19.852769 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e45ab88c-b2a2-430c-8b45-9d7af06cffcc req-1585a171-0d6c-4450-ab23-b3fd20aa741c service neutron] 10.222.0.71 "GET /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1321793 Nov 24 16:14:20.754477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e0eb81-00a0-489c-8d07-74f5c7c133bf req-34e641a8-6daa-4bef-a54f-fb790d1fd151 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:20.755955 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-52e0eb81-00a0-489c-8d07-74f5c7c133bf req-34e641a8-6daa-4bef-a54f-fb790d1fd151 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0574954 Nov 24 16:14:20.806490 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-52e0eb81-00a0-489c-8d07-74f5c7c133bf req-9a6afb48-ad74-43d6-bfe5-291391683959 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445049 Nov 24 16:14:21.275292 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ea36f6f2-9efd-4dc0-9f08-1bfc695f23ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:21.950077 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9c0f70-155a-4439-badb-e43ba6184802 req-bb39ba41-2338-4b1a-91da-6c47ada1e465 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:21.951587 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8e9c0f70-155a-4439-badb-e43ba6184802 req-bb39ba41-2338-4b1a-91da-6c47ada1e465 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0626943 Nov 24 16:14:22.005979 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8e9c0f70-155a-4439-badb-e43ba6184802 req-fd1d9268-a938-4db3-92bf-d7a419e92a9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468237 Nov 24 16:14:22.664211 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:23.139096 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df88119b-07a3-4430-a3ef-2c04fbaaac7a req-40578d1a-54e8-4913-8c4f-47e528c24b39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:23.140720 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-df88119b-07a3-4430-a3ef-2c04fbaaac7a req-40578d1a-54e8-4913-8c4f-47e528c24b39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0546393 Nov 24 16:14:23.189613 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-df88119b-07a3-4430-a3ef-2c04fbaaac7a req-b17533b8-e6b7-47a7-aad8-b3eb866730f7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428300 Nov 24 16:14:24.329216 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:24.480936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:33.000141 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:14:33.795183 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96043303-f205-4381-a010-7ea5a9c7e4b1 req-63fdb0a5-0455-4d26-867e-0c2478885f32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:33.797484 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96043303-f205-4381-a010-7ea5a9c7e4b1 req-63fdb0a5-0455-4d26-867e-0c2478885f32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0700533 Nov 24 16:14:33.853461 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-96043303-f205-4381-a010-7ea5a9c7e4b1 req-d9ccb8b1-ecff-4805-b0f3-38cfa0c79da3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449677 Nov 24 16:14:34.982037 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742d44ec-1e23-468e-bfd1-f82d73b417ac req-2a40d32d-dc3f-4b4d-b745-28eecc84c255 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:34.983754 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-742d44ec-1e23-468e-bfd1-f82d73b417ac req-2a40d32d-dc3f-4b4d-b745-28eecc84c255 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0515645 Nov 24 16:14:35.050947 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-742d44ec-1e23-468e-bfd1-f82d73b417ac req-8a4ee659-026b-4396-9d54-a4cb846f6722 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578203 Nov 24 16:14:35.950532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-15157d80-caf1-40cc-8c7b-b206d8d49081 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:35.953271 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-15157d80-caf1-40cc-8c7b-b206d8d49081 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0537045 Nov 24 16:14:36.060056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Deleting port e95db78b-d6c2-46b5-b57f-c37954356d5c {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:36.060393 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.210508 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] For port e95db78b-d6c2-46b5-b57f-c37954356d5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=e95db78b-d6c2-46b5-b57f-c37954356d5c,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:36.210789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.238128 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 req-bc99e12a-0705-4185-b810-09a1ba518c37 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:36.240010 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 req-bc99e12a-0705-4185-b810-09a1ba518c37 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 945 time: 0.0946474 Nov 24 16:14:36.375140 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 req-99ef60e1-6618-43bb-bd64-2c77acf8b43f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups?id=745f559c-3d80-495a-8a2a-2d7ac697d872&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055624 Nov 24 16:14:36.451522 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.451881 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.452894 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Floating IP c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f disassociated. External IP: 172.27.0.214, port: e95db78b-d6c2-46b5-b57f-c37954356d5c. Nov 24 16:14:36.453289 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling delete_port for e95db78b-d6c2-46b5-b57f-c37954356d5c owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:36.597346 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.629697 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'Port': ['ID=e95db78b-d6c2-46b5-b57f-c37954356d5c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:36.642760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.643140 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.643455 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.643792 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.644147 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.644454 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.644787 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.645153 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.645489 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.645819 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.646157 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.646475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.770407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:14:36.889384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:14:36.901412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:14:36.917318 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:36.918270 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:14:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:36.953437 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] No DVR routers for this DVR port e95db78b-d6c2-46b5-b57f-c37954356d5c on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:14:36.957112 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.963407 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 req-798d7241-8b0d-4f5c-a7cf-0a279de8fc84 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.71 "DELETE /v2.0/ports/e95db78b-d6c2-46b5-b57f-c37954356d5c HTTP/1.1" status: 204 len: 173 time: 1.0037372 Nov 24 16:14:36.963920 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'name': 'network-vif-deleted', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:14:36.968417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9" -d '{"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-deleted", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:14:37.077205 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:14:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a x-openstack-request-id: req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:14:37.077532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-deleted", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:14:37.077878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:14:37.079696 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c8582c22-790a-4760-84f8-78b7929748d3', 'name': 'network-vif-deleted', 'tag': 'e95db78b-d6c2-46b5-b57f-c37954356d5c', 'status': 'completed', 'code': 200} Nov 24 16:14:37.138672 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:37.497595 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:37.574665 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 req-6f0c65d6-ae91-44de-96a8-f88b1b575ca3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/ports?device_id=c8582c22-790a-4760-84f8-78b7929748d3 HTTP/1.1" status: 200 len: 210 time: 0.0512495 Nov 24 16:14:37.659237 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:14:37.668532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:37.669195 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:14:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:37.786382 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:37.997223 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:38.030091 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea901052-fa10-4d11-93ea-2674b3313874 None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:05:23Z', 'revision_number': 4, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c30a2f5a-8b67-4015-bf85-aad19ac790a9', 'name': '', 'network_id': 'd785b693-1522-4c61-9c47-37993ec7d517', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'mac_address': 'fa:16:3e:31:34:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:19Z', 'updated_at': '2021-11-24T16:05:33Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'subnets': [{'id': '6f721a8b-2f8a-4509-b0fb-4eea2f82fd87', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:14:38.275596 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95631567-bbd0-49d9-9304-d6bf59cd935c None None] New status for floating IP c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:14:38.668063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39456) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:38.731618 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:38.757254 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:38.810685 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:38.814064 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:38.815433 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /v2.0/security-groups/745f559c-3d80-495a-8a2a-2d7ac697d872 HTTP/1.1" status: 204 len: 168 time: 0.1462660 Nov 24 16:14:38.818561 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39458) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:38.829825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b564a2dc-bfcf-4d04-b486-dd0689dd5b1c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=745f559c-3d80-495a-8a2a-2d7ac697d872,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:38.841663 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.api.v2.resource [None req-8af2d897-baaf-4e32-9291-3a866dca7777 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] show failed (client error): The resource could not be found. Nov 24 16:14:38.843792 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8af2d897-baaf-4e32-9291-3a866dca7777 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /v2.0/security-groups/745f559c-3d80-495a-8a2a-2d7ac697d872 HTTP/1.1" status: 404 len: 347 time: 0.0236156 Nov 24 16:14:38.848215 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39460) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:38.982421 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Deleting port 6fab1473-c03d-472a-b867-7a71a408c15b {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:38.982864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.089432 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.089744 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.104147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling delete_port for 6fab1473-c03d-472a-b867-7a71a408c15b owned by network:floatingip {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:39.291115 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.320961 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Pushing event deleted for resources: {'Port': ['ID=6fab1473-c03d-472a-b867-7a71a408c15b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:39.335584 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device e95db78b-d6c2-46b5-b57f-c37954356d5c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:14:39.336493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.336493 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.336836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.336836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.337365 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.337530 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.337999 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.338253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.338854 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.339031 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.339274 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.339583 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:39.366729 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: e95db78b-d6c2-46b5-b57f-c37954356d5c {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:14:39.367778 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device e95db78b-d6c2-46b5-b57f-c37954356d5c not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:14:39.410611 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks [] for floatingip, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.412294 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:39.413512 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b0e9bda1-16ee-4003-87c5-26a43a4c5296 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /v2.0/floatingips/c1c21c1b-bc30-4f7a-a23b-8d6dcc0d357f HTTP/1.1" status: 204 len: 168 time: 0.5641840 Nov 24 16:14:43.075957 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39488) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:43.567566 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:43.841242 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Deleting port c30a2f5a-8b67-4015-bf85-aad19ac790a9 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:43.841534 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:43.927590 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] For port c30a2f5a-8b67-4015-bf85-aad19ac790a9, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c30a2f5a-8b67-4015-bf85-aad19ac790a9,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:43.928255 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:43.944970 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Calling delete_port for c30a2f5a-8b67-4015-bf85-aad19ac790a9 owned by network:router_interface {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:44.136623 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.166838 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Pushing event deleted for resources: {'Port': ['ID=c30a2f5a-8b67-4015-bf85-aad19ac790a9,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:44.264579 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.356260 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.851261 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:14:44.962854 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:14:44.968508 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4c03d332-f7e4-4631-b902-65d60157e0d7 admin admin] 10.222.0.72 "PUT /v2.0/routers/eb40aed5-eb33-44c4-ad15-8fb8e02c47ba/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8913617 Nov 24 16:14:44.975659 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Sync routers for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:14:44.975989 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39494) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:44.982829 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:44.983585 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:14:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:45.081991 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks [] for router, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.093397 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:45.224134 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.295154 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Deleting port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:45.295641 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.313541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131'}], 'enable_snat': True}, 'gw_port_id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:14:44Z', 'revision_number': 5, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port': {'id': '80bf6606-45fd-4eed-91cc-ef6dbae00eb0', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:61:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:45.341638 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Checking router: eb40aed5-eb33-44c4-ad15-8fb8e02c47ba for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:14:45.351607 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Routers {'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:45.352222 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:14:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:45.386379 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] For port 80bf6606-45fd-4eed-91cc-ef6dbae00eb0, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:45.386640 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.401282 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Calling delete_port for 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 owned by network:router_gateway {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:45.442444 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] Set router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba gateway port host: None {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:45.499701 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:14:45Z', 'revision_number': 6, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:45.529707 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84675a67-a19a-495d-a872-eb6b71830b0d None None] The sync data for ids ['eb40aed5-eb33-44c4-ad15-8fb8e02c47ba'] in dv-cinder-818994-2-iscsi is: [{'id': 'eb40aed5-eb33-44c4-ad15-8fb8e02c47ba', 'name': 'tempest-AttachVolumeTestJSON-1708063480-router', 'tenant_id': '1c341b845ae6468b847beba4eee796dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:07Z', 'updated_at': '2021-11-24T16:14:45Z', 'revision_number': 6, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'gw_port_host': None}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:14:45.603794 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.630371 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Pushing event deleted for resources: {'Port': ['ID=80bf6606-45fd-4eed-91cc-ef6dbae00eb0,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:45.697848 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.789930 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.792117 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.838283 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.838789 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Fanout notify agent at l3_agent the message router_deleted on router eb40aed5-eb33-44c4-ad15-8fb8e02c47ba {{(pid=102787) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:14:45.843986 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.845167 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2053dcba-ce82-472e-967f-9e8d3857828b admin admin] 10.222.0.72 "DELETE /v2.0/routers/eb40aed5-eb33-44c4-ad15-8fb8e02c47ba HTTP/1.1" status: 204 len: 168 time: 0.8707027 Nov 24 16:14:45.849166 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39496) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:45.902686 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Deleting subnet 6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:14:45.907045 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.949931 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.065803 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.131847 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.159241 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6f721a8b-2f8a-4509-b0fb-4eea2f82fd87,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:46.163811 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.169305 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc032694-a6a9-45ff-a11d-e9d18c1d816a None None] Network d785b693-1522-4c61-9c47-37993ec7d517 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:46.169496 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7eb10be2-3626-4ec4-900c-9909d37ed123 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/6f721a8b-2f8a-4509-b0fb-4eea2f82fd87 HTTP/1.1" status: 204 len: 168 time: 0.3189690 Nov 24 16:14:46.172602 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39498) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:46.254487 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.315969 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Deleting port 2979a199-79d3-4f57-925e-0ba22f53d24b {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:46.316313 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.393414 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] For port 2979a199-79d3-4f57-925e-0ba22f53d24b, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=2979a199-79d3-4f57-925e-0ba22f53d24b,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:46.393770 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.399475 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] DHCP port deletion for d785b693-1522-4c61-9c47-37993ec7d517 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:14:46.408714 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Calling delete_port for 2979a199-79d3-4f57-925e-0ba22f53d24b owned by network:dhcp {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:46.455764 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Deleting port 2979a199-79d3-4f57-925e-0ba22f53d24b {{(pid=102789) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:14:46.456286 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.510278 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.539566 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] For port 2979a199-79d3-4f57-925e-0ba22f53d24b, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=2979a199-79d3-4f57-925e-0ba22f53d24b,segment=NetworkSegment(74f01bad-61a2-41c6-9cce-ac0e3acebb69),segment_id=74f01bad-61a2-41c6-9cce-ac0e3acebb69)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:46.539987 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.546094 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Pushing event deleted for resources: {'Port': ['ID=2979a199-79d3-4f57-925e-0ba22f53d24b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:46.551864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] No DVR routers for this DVR port 2979a199-79d3-4f57-925e-0ba22f53d24b on host dv-cinder-818994-2-iscsi {{(pid=102787) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:14:46.565160 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Calling delete_port for 2979a199-79d3-4f57-925e-0ba22f53d24b owned by network:dhcp {{(pid=102789) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:14:46.650595 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.662555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.699428 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d785b693-1522-4c61-9c47-37993ec7d517']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:46.708948 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Pushing event deleted for resources: {'Port': ['ID=2979a199-79d3-4f57-925e-0ba22f53d24b,revision_number=None']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:46.713633 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] No DVR routers for this DVR port 2979a199-79d3-4f57-925e-0ba22f53d24b on host dv-cinder-818994-2-iscsi {{(pid=102789) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:14:46.716320 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '74f01bad-61a2-41c6-9cce-ac0e3acebb69') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:46.716605 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '74f01bad-61a2-41c6-9cce-ac0e3acebb69') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:46.724662 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.725289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.725864 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.729068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.729068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.729068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.729068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.729068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.730213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.731165 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.731165 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.731772 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3b5991-4d02-4120-b61e-47241e0511e2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:46.740494 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.759535 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.766800 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Releasing vlan 1041 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:14:46.767297 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:14:46.769492 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:14:46.825598 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.831066 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.835481 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] 10.222.0.72 "DELETE /v2.0/networks/d785b693-1522-4c61-9c47-37993ec7d517 HTTP/1.1" status: 204 len: 168 time: 0.6614540 Nov 24 16:14:46.856185 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3415b8-e823-4538-bda7-9869a534fe11 admin admin] Pushing event deleted for resources: {'Network': ['ID=d785b693-1522-4c61-9c47-37993ec7d517,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:46.974505 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39502) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:47.018798 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6cfc9063-f920-408d-8465-8be68bcf1343 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1c341b845ae6468b847beba4eee796dd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0415311 Nov 24 16:14:47.019934 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39504) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:47.069515 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:47.091789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:47.152752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:47.157290 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:47.160981 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8ae5efb3-f95b-42dc-9d0f-ec9291a6fd2f HTTP/1.1" status: 204 len: 168 time: 0.1378040 Nov 24 16:14:47.170117 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bfa893-71ec-490c-a0d1-2071393d7830 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ae5efb3-f95b-42dc-9d0f-ec9291a6fd2f,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:47.182863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:14:47.222520 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:14:47.222876 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 80bf6606-45fd-4eed-91cc-ef6dbae00eb0 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:14:47.223341 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c30a2f5a-8b67-4015-bf85-aad19ac790a9 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:14:47.245706 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: c30a2f5a-8b67-4015-bf85-aad19ac790a9 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:14:47.246328 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c30a2f5a-8b67-4015-bf85-aad19ac790a9 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:14:47.246762 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 2979a199-79d3-4f57-925e-0ba22f53d24b no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:14:47.268853 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 2979a199-79d3-4f57-925e-0ba22f53d24b {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:14:47.269241 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 2979a199-79d3-4f57-925e-0ba22f53d24b not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:14:48.610323 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f1380b70-60d1-49f2-8e3b-d23e4a867f10 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:51.269004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-88644744-9f24-41ed-ade4-22625aaa3b61 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:52.658577 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.332643 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.482846 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.666610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39622) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:56.781798 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-04f5ee0a-8790-4bcc-94c1-3946ffd8d48f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.863475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-04f5ee0a-8790-4bcc-94c1-3946ffd8d48f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.868657 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-04f5ee0a-8790-4bcc-94c1-3946ffd8d48f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.910857 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f5ee0a-8790-4bcc-94c1-3946ffd8d48f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90c3a2e4-7cb7-46dc-9a9a-f8e06c233e23,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:56.915563 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-04f5ee0a-8790-4bcc-94c1-3946ffd8d48f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b3bfa4e3a1b649a8855d07d953d2ba4e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2477467 Nov 24 16:14:56.918302 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39626) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:56.997702 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.038889 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.103733 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.106664 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.108611 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/90c3a2e4-7cb7-46dc-9a9a-f8e06c233e23 HTTP/1.1" status: 204 len: 168 time: 0.1891384 Nov 24 16:14:57.120703 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb04d76c-8a25-41a8-8614-752579f3ad6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90c3a2e4-7cb7-46dc-9a9a-f8e06c233e23,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:57.806817 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39648) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:57.909847 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1137215701-network', 'tenant_id': '6d1879295a654fdca8a62b46f31d6fd9'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:57.932131 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Made reservation on behalf of 6d1879295a654fdca8a62b46f31d6fd9 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:57.934502 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.944106 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.028096 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.032570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.058570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1045} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:14:58.069518 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9aa4b09d-9313-459a-99c8-45bb8a585faf,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:58.075677 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.076702 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Added segment e97caba8-6a98-4d35-8e26-56c22e22bf70 of type vlan for network c3764955-381c-4d10-82a8-02614c646df4 Nov 24 16:14:58.123492 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.155295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.156644 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:58.157136 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.196034 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.3880832 Nov 24 16:14:58.199737 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39652) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:58.208077 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Request body: {'subnet': {'network_id': 'c3764955-381c-4d10-82a8-02614c646df4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1137215701-subnet', 'tenant_id': '6d1879295a654fdca8a62b46f31d6fd9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:58.224471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1d689d-1466-4aa2-9f3f-35b61248d9ec admin admin] Pushing event updated for resources: {'Network': ['ID=c3764955-381c-4d10-82a8-02614c646df4,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:58.236368 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network c3764955-381c-4d10-82a8-02614c646df4 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:14:58.239232 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Made reservation on behalf of 6d1879295a654fdca8a62b46f31d6fd9 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:58.242845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.423577 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.491889 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eee767c9-da52-49f9-ab0f-7ff8b4966ee5,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:58.502355 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Checking segment: {'id': 'e97caba8-6a98-4d35-8e26-56c22e22bf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1045, 'network_id': 'c3764955-381c-4d10-82a8-02614c646df4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:58.502720 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Network hostable DHCP agents. Network: c3764955-381c-4d10-82a8-02614c646df4, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:14:58.520081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Network c3764955-381c-4d10-82a8-02614c646df4 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:14:58.529830 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, c3764955-381c-4d10-82a8-02614c646df4) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:58.534658 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:58.535171 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.540248 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc895066-a434-4e40-91f8-7449d85855c5 None None] Network c3764955-381c-4d10-82a8-02614c646df4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:58.564807 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-ff5c38eb-6c25-49e4-b1aa-d01d89a54008 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3635070 Nov 24 16:14:58.697316 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-229af374-ab12-45a8-8ebc-ac2f483d5d47 None None] Network c3764955-381c-4d10-82a8-02614c646df4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:59.100175 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39670) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:59.105124 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1025498532-network', 'tenant_id': '18eb0e4304ee469fac3d90508ec839c0'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:59.128688 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Made reservation on behalf of 18eb0e4304ee469fac3d90508ec839c0 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:59.131112 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.141908 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.226318 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.230665 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.255699 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1016} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:14:59.265955 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b246ca3-5267-4214-88f0-ff0db2017648,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:59.270686 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.271026 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Added segment 42d7f15d-5eff-4533-94f3-d5775671d336 of type vlan for network 27e27367-79fa-4323-bb27-8eef796eddd4 Nov 24 16:14:59.313839 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.340420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.341571 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:59.342550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.380354 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.2790296 Nov 24 16:14:59.381380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39672) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:59.386531 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Request body: {'subnet': {'network_id': '27e27367-79fa-4323-bb27-8eef796eddd4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1025498532-subnet', 'tenant_id': '18eb0e4304ee469fac3d90508ec839c0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:59.411141 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Made reservation on behalf of 18eb0e4304ee469fac3d90508ec839c0 for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:59.412085 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bc452d-9d7a-4046-8290-0d5876a5ca99 admin admin] Pushing event updated for resources: {'Network': ['ID=27e27367-79fa-4323-bb27-8eef796eddd4,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:59.414047 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29486263'] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.423065 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 27e27367-79fa-4323-bb27-8eef796eddd4 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:14:59.596748 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29518501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29486213'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.655706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Pushing event updated for resources: {'Subnet': ['ID=9dced542-a553-43e6-a7c2-7734d734b932,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:59.664273 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Checking segment: {'id': '42d7f15d-5eff-4533-94f3-d5775671d336', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1016, 'network_id': '27e27367-79fa-4323-bb27-8eef796eddd4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:59.664636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Network hostable DHCP agents. Network: 27e27367-79fa-4323-bb27-8eef796eddd4, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:14:59.681621 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Network 27e27367-79fa-4323-bb27-8eef796eddd4 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:14:59.689996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 27e27367-79fa-4323-bb27-8eef796eddd4) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:59.694013 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:59.694601 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.699681 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03f4828f-8ce6-482c-8101-a832f278ad3a None None] Network 27e27367-79fa-4323-bb27-8eef796eddd4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:59.710713 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-2d38d4bd-b426-4890-beb5-c690628dbafd admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3281980 Nov 24 16:14:59.839266 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39676) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:59.885650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Deleting subnet eee767c9-da52-49f9-ab0f-7ff8b4966ee5 {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:14:59.889503 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.925756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30444690'] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:59.949405 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16599b37-da99-4278-adec-f04ac52ac3eb None None] Network 27e27367-79fa-4323-bb27-8eef796eddd4 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:59.980428 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.036028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29518436', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29486226'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.089863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eee767c9-da52-49f9-ab0f-7ff8b4966ee5,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:00.093069 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.098798 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-abfa16cc-2d7b-42a8-8521-d785024b7279 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/eee767c9-da52-49f9-ab0f-7ff8b4966ee5 HTTP/1.1" status: 204 len: 168 time: 0.2581882 Nov 24 16:15:00.101367 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39678) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:00.209352 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.292899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.314496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3764955-381c-4d10-82a8-02614c646df4']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.323707 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e97caba8-6a98-4d35-8e26-56c22e22bf70') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.324002 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e97caba8-6a98-4d35-8e26-56c22e22bf70') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.334307 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.347584 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.353528 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Releasing vlan 1045 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:15:00.353920 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:15:00.355599 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:15:00.411182 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.417231 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.421394 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] 10.222.0.72 "DELETE /v2.0/networks/c3764955-381c-4d10-82a8-02614c646df4 HTTP/1.1" status: 204 len: 168 time: 0.3186953 Nov 24 16:15:00.424913 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39680) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:00.437203 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad40973-69a3-4598-8fcf-0e783a3b386a admin admin] Pushing event deleted for resources: {'Network': ['ID=c3764955-381c-4d10-82a8-02614c646df4,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:00.473623 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Deleting subnet 9dced542-a553-43e6-a7c2-7734d734b932 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:15:00.480465 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.522274 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.565150 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.631630 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.655795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9dced542-a553-43e6-a7c2-7734d734b932,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:00.664044 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.667348 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-949f11e8-bf8a-4fcd-b971-503faaa64fbf admin admin] 10.222.0.72 "DELETE /v2.0/subnets/9dced542-a553-43e6-a7c2-7734d734b932 HTTP/1.1" status: 204 len: 168 time: 0.2417967 Nov 24 16:15:00.670539 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39682) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:00.741550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.833203 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.856445 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['27e27367-79fa-4323-bb27-8eef796eddd4']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.867907 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42d7f15d-5eff-4533-94f3-d5775671d336') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.868210 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42d7f15d-5eff-4533-94f3-d5775671d336') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:00.879804 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.895946 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.903005 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Releasing vlan 1016 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:15:00.903431 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:15:00.905348 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:15:00.972791 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.979105 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:00.983511 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] 10.222.0.72 "DELETE /v2.0/networks/27e27367-79fa-4323-bb27-8eef796eddd4 HTTP/1.1" status: 204 len: 168 time: 0.3118021 Nov 24 16:15:00.995247 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d58f3f-3f3c-42cf-86ac-3936810cb295 admin admin] Pushing event deleted for resources: {'Network': ['ID=27e27367-79fa-4323-bb27-8eef796eddd4,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:01.150184 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39686) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:01.191195 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-518258f7-2ad5-4f4d-ba31-dbf1046538a7 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6d1879295a654fdca8a62b46f31d6fd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398371 Nov 24 16:15:01.193683 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39688) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:01.241768 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.264478 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.317016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.319755 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.320905 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9aa4b09d-9313-459a-99c8-45bb8a585faf HTTP/1.1" status: 204 len: 168 time: 0.1263235 Nov 24 16:15:01.329954 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f770ab2f-1070-426c-a7a1-263bd71f668f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9aa4b09d-9313-459a-99c8-45bb8a585faf,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:01.667894 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39694) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:01.708679 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a071d339-7460-443f-866c-eefe802f31b6 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=18eb0e4304ee469fac3d90508ec839c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0395870 Nov 24 16:15:01.711145 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39696) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:01.765799 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.788141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.835719 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.838764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.840010 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/1b246ca3-5267-4214-88f0-ff0db2017648 HTTP/1.1" status: 204 len: 168 time: 0.1279504 Nov 24 16:15:01.849937 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848bf12a-290f-48ae-b1ff-5461f587114a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b246ca3-5267-4214-88f0-ff0db2017648,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:04.680922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39830) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:04.790313 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ba5e4d2-9738-4997-9ef2-49ecc164a162 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:04.874029 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ba5e4d2-9738-4997-9ef2-49ecc164a162 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:04.879234 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2ba5e4d2-9738-4997-9ef2-49ecc164a162 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:04.918861 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2ba5e4d2-9738-4997-9ef2-49ecc164a162 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f26051d41d9b4bb4adbc9c1358c4450e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2368064 Nov 24 16:15:04.919584 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba5e4d2-9738-4997-9ef2-49ecc164a162 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26bc8aa3-e186-4edf-a3ed-0c46565cbae5,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:04.922136 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39834) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:04.975487 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:04.997174 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.045254 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.047915 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.049070 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/26bc8aa3-e186-4edf-a3ed-0c46565cbae5 HTTP/1.1" status: 204 len: 168 time: 0.1251671 Nov 24 16:15:05.057724 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77ed270-b81f-4dbd-ac0f-2172fd01df6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26bc8aa3-e186-4edf-a3ed-0c46565cbae5,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:05.313506 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 39840) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:05.327201 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-02b59f78-dc1b-49fe-b3fc-f4ae8952dbc2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.414828 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-02b59f78-dc1b-49fe-b3fc-f4ae8952dbc2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.418800 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-02b59f78-dc1b-49fe-b3fc-f4ae8952dbc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.458210 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-02b59f78-dc1b-49fe-b3fc-f4ae8952dbc2 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=9fe451729ea14c81bc409d0e10c16c0a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1435955 Nov 24 16:15:05.459225 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b59f78-dc1b-49fe-b3fc-f4ae8952dbc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ddf0b66-8a37-4c63-8db2-bcf9bf35937c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:05.461411 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 39842) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:05.511366 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.539844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.591898 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.594653 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.595816 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7ddf0b66-8a37-4c63-8db2-bcf9bf35937c HTTP/1.1" status: 204 len: 168 time: 0.1333010 Nov 24 16:15:05.603637 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b42ec86-1aa6-42cf-b9cd-68d9ddbf4bc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ddf0b66-8a37-4c63-8db2-bcf9bf35937c,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:09.999984 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:15:14.247940 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:18.612538 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bbe6fd27-9ed3-4d3b-b159-c9d6071fd20e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:21.271539 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf83820-4144-4dfd-9e86-d61c41b34975 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:22.662134 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:22.879470 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-f09562f6-8e91-461f-bd12-e5ec00e7a519 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0447814 Nov 24 16:15:24.226741 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961811f9-0d52-454b-b60d-87c14687fd88 req-fb3fbce7-4e85-49cd-862b-2bd250fc2ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:24.228227 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-fb3fbce7-4e85-49cd-862b-2bd250fc2ad3 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 1099 time: 0.0402668 Nov 24 16:15:24.336026 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:24.342793 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961811f9-0d52-454b-b60d-87c14687fd88 req-44994582-b1bf-47ff-bcef-f1968caba3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:24.344362 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-44994582-b1bf-47ff-bcef-f1968caba3f2 service neutron] 10.222.0.71 "GET /v2.0/networks?id=282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 200 len: 918 time: 0.0911756 Nov 24 16:15:24.415546 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-189bb325-d715-4b2b-8fdf-b357b20e4ba8 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 200 len: 1001 time: 0.0622807 Nov 24 16:15:24.463747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961811f9-0d52-454b-b60d-87c14687fd88 req-fdf3e5a1-a551-4ad6-a8dd-29c384d4328c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:24.465227 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-fdf3e5a1-a551-4ad6-a8dd-29c384d4328c service neutron] 10.222.0.71 "GET /v2.0/subnets?id=2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 200 len: 855 time: 0.0431135 Nov 24 16:15:24.483769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:24.512038 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961811f9-0d52-454b-b60d-87c14687fd88 req-6fdaad24-77f8-4560-8905-f7ea4b764126 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:24.513608 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-6fdaad24-77f8-4560-8905-f7ea4b764126 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=282e5dca-255c-487d-a4fd-a70d7293f6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413463 Nov 24 16:15:24.610991 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-1f381daa-d682-47ee-8785-1701d1cbebaa service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902953 Nov 24 16:15:24.705002 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-961811f9-0d52-454b-b60d-87c14687fd88 req-3c2f94ff-26d6-4fd5-8267-9d26328bbc6e service neutron] 10.222.0.71 "GET /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865576 Nov 24 16:15:27.641580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4b9c51-1112-4515-b692-652c74a13254 req-74f32099-e9bc-4c1b-a0ef-4058ff993602 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:27.643071 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cd4b9c51-1112-4515-b692-652c74a13254 req-74f32099-e9bc-4c1b-a0ef-4058ff993602 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.2001057 Nov 24 16:15:27.690397 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cd4b9c51-1112-4515-b692-652c74a13254 req-06aa93e4-944f-4a12-ac58-ee981c90a7e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413375 Nov 24 16:15:28.870715 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 req-7dd32b64-6031-47fa-a328-4c76d4ce0556 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:28.873891 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 req-7dd32b64-6031-47fa-a328-4c76d4ce0556 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.1064594 Nov 24 16:15:28.920081 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 req-ad59a962-8861-4049-83f3-def4cc5e534c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403523 Nov 24 16:15:30.040068 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f req-8170f144-8d13-4dee-8715-64e0f0df4b64 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:30.041582 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f req-8170f144-8d13-4dee-8715-64e0f0df4b64 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0498869 Nov 24 16:15:30.091171 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f req-ca09d2d0-3b4f-4eb1-85c8-0769bd591cf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436509 Nov 24 16:15:31.211126 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c8c8845-d86a-4032-9f0c-290f8d60006c req-dae03502-799b-4001-ae27-50bb622de8a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:31.213188 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4c8c8845-d86a-4032-9f0c-290f8d60006c req-dae03502-799b-4001-ae27-50bb622de8a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0479441 Nov 24 16:15:31.259493 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4c8c8845-d86a-4032-9f0c-290f8d60006c req-5b1aa575-6e83-4a4a-ab35-fd491fb39dc1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408800 Nov 24 16:15:32.368483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-58a81acb-8622-45bf-948c-54e7c86f1ca2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:32.369961 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-58a81acb-8622-45bf-948c-54e7c86f1ca2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0781546 Nov 24 16:15:32.416826 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb08817-09f0-47cd-98cf-e175baa172e2 req-c0b7df01-3466-4ef7-ba10-4c250ea3fd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:32.418203 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffb08817-09f0-47cd-98cf-e175baa172e2 req-c0b7df01-3466-4ef7-ba10-4c250ea3fd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 946 time: 0.0845702 Nov 24 16:15:32.494757 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ffb08817-09f0-47cd-98cf-e175baa172e2 req-6f7de9c6-ba91-4f9f-abcc-12dcb856773a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups?id=71870c06-174e-486c-ac20-e4e17ae76723&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686045 Nov 24 16:15:32.509553 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Deleting port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:32.509892 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:32.595149 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] For port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:32.596110 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:32.763548 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:32.763911 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:32.764238 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Floating IP 733175a7-f3aa-4d5d-8a5b-ef755cf9b812 disassociated. External IP: 172.27.0.235, port: 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44. Nov 24 16:15:32.764584 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling delete_port for 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:32.899928 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:32.930031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'Port': ['ID=4d38b5c2-e149-4f9c-bcdf-1f06131c0c44,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:33.041283 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:15:33.150841 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:15:33.160610 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:15:33.169863 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:33.170467 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:33.190041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] No DVR routers for this DVR port 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:15:33.192632 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:33.196166 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e2aeb471-297b-4f96-bae5-95874cc2fa51 req-511cdda4-0c41-42ad-9c1e-44053804aceb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.71 "DELETE /v2.0/ports/4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 HTTP/1.1" status: 204 len: 173 time: 0.8196518 Nov 24 16:15:33.196696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-deleted', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:15:33.198887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b" -d '{"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-deleted", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:15:33.236106 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:15:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 x-openstack-request-id: req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:15:33.236453 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-deleted", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:15:33.237188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:15:33.237340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b62212ea-7c11-4095-adf5-a78b04d67de0', 'name': 'network-vif-deleted', 'tag': '4d38b5c2-e149-4f9c-bcdf-1f06131c0c44', 'status': 'completed', 'code': 200} Nov 24 16:15:33.279738 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:33.518379 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:33.545130 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:15:33.561182 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:33.562381 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:33.658414 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 req-a673ec5c-4dd5-4ee3-b941-02fabd5e1994 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/ports?device_id=b62212ea-7c11-4095-adf5-a78b04d67de0 HTTP/1.1" status: 200 len: 210 time: 0.0597603 Nov 24 16:15:33.712787 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:33.921077 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:33.947108 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a0cae06-e5ac-4816-adac-aaa3d581ed8b None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:05:12Z', 'revision_number': 4, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '838c6cdf-c823-41c0-8fd9-23daaee0913f', 'name': '', 'network_id': '282e5dca-255c-487d-a4fd-a70d7293f6b8', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'mac_address': 'fa:16:3e:64:67:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:10Z', 'updated_at': '2021-11-24T16:05:24Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'subnets': [{'id': '2243cd13-32e0-4ca8-9d04-3e463c6c8988', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:15:34.168476 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782c205b-6768-4a5d-bc7e-88454cc4fd75 None None] New status for floating IP 733175a7-f3aa-4d5d-8a5b-ef755cf9b812: DOWN {{(pid=102789) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:15:34.758951 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40050) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:34.815562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:34.838235 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:34.884898 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:34.887426 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:34.888556 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /v2.0/security-groups/71870c06-174e-486c-ac20-e4e17ae76723 HTTP/1.1" status: 204 len: 168 time: 0.1286268 Nov 24 16:15:34.891391 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40052) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:34.897815 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f21a38ff-befe-4152-98b9-67a6d9048232 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=71870c06-174e-486c-ac20-e4e17ae76723,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:34.908689 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.api.v2.resource [None req-10aa7f3f-3482-43f8-9727-55f253c80991 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] show failed (client error): The resource could not be found. Nov 24 16:15:34.912913 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-10aa7f3f-3482-43f8-9727-55f253c80991 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /v2.0/security-groups/71870c06-174e-486c-ac20-e4e17ae76723 HTTP/1.1" status: 404 len: 347 time: 0.0178719 Nov 24 16:15:34.913221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40054) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:35.038053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Deleting port 507470e5-6137-42d0-8a90-f2ca32d88103 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:35.038392 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.112579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.112910 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.124471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling delete_port for 507470e5-6137-42d0-8a90-f2ca32d88103 owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:35.259626 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.286051 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Pushing event deleted for resources: {'Port': ['ID=507470e5-6137-42d0-8a90-f2ca32d88103,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:35.347750 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.350395 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:35.351563 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0b103f03-439c-42d7-84d8-2f2fddc0354c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /v2.0/floatingips/733175a7-f3aa-4d5d-8a5b-ef755cf9b812 HTTP/1.1" status: 204 len: 168 time: 0.4374249 Nov 24 16:15:35.753470 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:15:35.774029 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:15:35.774374 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:15:40.920324 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40100) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:41.387214 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:41.930896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Deleting port 838c6cdf-c823-41c0-8fd9-23daaee0913f {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:41.931628 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:42.032041 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] For port 838c6cdf-c823-41c0-8fd9-23daaee0913f, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=838c6cdf-c823-41c0-8fd9-23daaee0913f,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:42.032622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:42.048036 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Calling delete_port for 838c6cdf-c823-41c0-8fd9-23daaee0913f owned by network:router_interface {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:42.252839 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:42.283583 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Pushing event deleted for resources: {'Port': ['ID=838c6cdf-c823-41c0-8fd9-23daaee0913f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:42.313523 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.313882 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.314232 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.314574 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.314914 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.315256 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.315595 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.315928 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.316257 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.316583 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.316914 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.317264 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:42.476212 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:42.711480 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Router 4659895c-56b7-4459-9ba6-d88a8c81621f has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:15:42.820151 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:15:42.825421 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-99f4c196-c43c-4594-bb8c-51f3dbddeaf3 admin admin] 10.222.0.72 "PUT /v2.0/routers/4659895c-56b7-4459-9ba6-d88a8c81621f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9040530 Nov 24 16:15:42.827882 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40140) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:42.830460 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Sync routers for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:15:42.842160 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:42.842827 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:42.935979 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks [] for router, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:42.948014 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:43.041222 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.099520 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Deleting port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:43.099821 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.188293 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] For port eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:43.188661 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.202288 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Calling delete_port for eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b owned by network:router_gateway {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:43.232295 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:15:42Z', 'revision_number': 5, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port': {'id': 'eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:40:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 47, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:05:05Z', 'updated_at': '2021-11-24T16:05:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:43.264692 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Checking router: 4659895c-56b7-4459-9ba6-d88a8c81621f for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:15:43.273209 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Routers {'4659895c-56b7-4459-9ba6-d88a8c81621f'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:43.273827 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4659895c-56b7-4459-9ba6-d88a8c81621f'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:43.360512 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] Set router 4659895c-56b7-4459-9ba6-d88a8c81621f gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:43.372700 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.398420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Pushing event deleted for resources: {'Port': ['ID=eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:43.410395 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:15:43Z', 'revision_number': 6, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:43.440469 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac8b2f32-1e3e-4a5f-b9d3-ae0bf7ffef80 None None] The sync data for ids ['4659895c-56b7-4459-9ba6-d88a8c81621f'] in dv-cinder-818994-2-iscsi is: [{'id': '4659895c-56b7-4459-9ba6-d88a8c81621f', 'name': 'tempest-AttachVolumeShelveTestJSON-564369334-router', 'tenant_id': '4ca913475fb04e7a8ea75d95578c8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:05:04Z', 'updated_at': '2021-11-24T16:15:43Z', 'revision_number': 6, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'gw_port_host': None}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:15:43.462795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.554306 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.556492 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.599143 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.599679 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4659895c-56b7-4459-9ba6-d88a8c81621f {{(pid=102787) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:15:43.604409 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.605679 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-1163e086-2a59-47ad-b30e-db7b38d7ec08 admin admin] 10.222.0.72 "DELETE /v2.0/routers/4659895c-56b7-4459-9ba6-d88a8c81621f HTTP/1.1" status: 204 len: 168 time: 0.7768726 Nov 24 16:15:43.608414 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40146) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:43.658975 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Deleting subnet 2243cd13-32e0-4ca8-9d04-3e463c6c8988 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:15:43.663463 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.698664 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.755373 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40150) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:43.781713 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.838872 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.866130 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2243cd13-32e0-4ca8-9d04-3e463c6c8988,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:43.869922 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.875936 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2745a928-fb33-478f-bdb7-23f2a924b17d admin admin] 10.222.0.72 "DELETE /v2.0/subnets/2243cd13-32e0-4ca8-9d04-3e463c6c8988 HTTP/1.1" status: 204 len: 168 time: 0.2641284 Nov 24 16:15:43.876123 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6974fb71-4ecd-4d09-b7fa-9f7ec184a76e None None] Network 282e5dca-255c-487d-a4fd-a70d7293f6b8 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:15:43.876629 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40154) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:43.916188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:43.976232 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.071149 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.077734 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.090631 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Deleting port 3d045898-91ac-4634-b168-eeaa9c87f097 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:44.091047 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.138803 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6911aad-52f1-4bbe-9675-40a7fa681a60,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.143889 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=2a445c05a0a84403837f06c39da7684f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3874972 Nov 24 16:15:44.147638 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40156) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:44.178017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.178370 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.178721 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.179058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.179393 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.179728 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.180062 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.180408 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.184881 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.185293 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.185635 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.185969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa90f82-daba-46bb-b2b1-8d4a26ed830b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:15:44.206041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] For port 3d045898-91ac-4634-b168-eeaa9c87f097, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=3d045898-91ac-4634-b168-eeaa9c87f097,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:44.206444 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.211604 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.226113 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] DHCP port deletion for 282e5dca-255c-487d-a4fd-a70d7293f6b8 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:15:44.227422 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Calling delete_port for 3d045898-91ac-4634-b168-eeaa9c87f097 owned by network:dhcp {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:44.240930 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.278132 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.300837 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Deleting port 3d045898-91ac-4634-b168-eeaa9c87f097 {{(pid=102789) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:15:44.301502 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.303560 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.307169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.308754 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e6911aad-52f1-4bbe-9675-40a7fa681a60 HTTP/1.1" status: 204 len: 168 time: 0.1601074 Nov 24 16:15:44.321710 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ee74ad-3e17-4b52-8c68-5f4f7a50edd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6911aad-52f1-4bbe-9675-40a7fa681a60,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.393644 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] For port 3d045898-91ac-4634-b168-eeaa9c87f097, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=3d045898-91ac-4634-b168-eeaa9c87f097,segment=NetworkSegment(4ba13f07-5206-4f2b-9083-f91096492150),segment_id=4ba13f07-5206-4f2b-9083-f91096492150)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:44.394413 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.412077 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Calling delete_port for 3d045898-91ac-4634-b168-eeaa9c87f097 owned by network:dhcp {{(pid=102789) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:15:44.512223 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.544731 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] Pushing event deleted for resources: {'Port': ['ID=3d045898-91ac-4634-b168-eeaa9c87f097,revision_number=None']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.551067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0de32832-9bca-4da6-9957-f65e6e7c3fd6 None None] No DVR routers for this DVR port 3d045898-91ac-4634-b168-eeaa9c87f097 on host dv-cinder-818994-2-iscsi {{(pid=102789) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:15:44.598203 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.628749 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=3d045898-91ac-4634-b168-eeaa9c87f097,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.638222 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] No DVR routers for this DVR port 3d045898-91ac-4634-b168-eeaa9c87f097 on host dv-cinder-818994-2-iscsi {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:15:44.695932 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40162) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:44.710165 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-806b6b31-381d-4f74-96dd-2daf1c655f6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.711860 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.731083 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['282e5dca-255c-487d-a4fd-a70d7293f6b8']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:44.741278 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4ba13f07-5206-4f2b-9083-f91096492150') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:44.741572 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4ba13f07-5206-4f2b-9083-f91096492150') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:44.752056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.766542 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.773787 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Releasing vlan 1047 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:15:44.774331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self.session.flush() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self.session.flush() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self.session.flush() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self.session.flush() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:15:44.776029 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:15:44.789624 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-806b6b31-381d-4f74-96dd-2daf1c655f6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.793382 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-806b6b31-381d-4f74-96dd-2daf1c655f6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.830600 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.830938 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806b6b31-381d-4f74-96dd-2daf1c655f6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c28cad4d-ba75-42f0-ad9f-624aaa7a5c44,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.837892 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.838332 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-806b6b31-381d-4f74-96dd-2daf1c655f6c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a31b3b80f1424e6683c70c82cb57afd4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1412396 Nov 24 16:15:44.841007 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40164) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:44.847061 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] 10.222.0.72 "DELETE /v2.0/networks/282e5dca-255c-487d-a4fd-a70d7293f6b8 HTTP/1.1" status: 204 len: 168 time: 0.9698961 Nov 24 16:15:44.870679 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595160d4-8115-4f64-990b-9e1dd5f193a0 admin admin] Pushing event deleted for resources: {'Network': ['ID=282e5dca-255c-487d-a4fd-a70d7293f6b8,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:44.892436 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.914744 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.961974 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.964589 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:44.966248 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c28cad4d-ba75-42f0-ad9f-624aaa7a5c44 HTTP/1.1" status: 204 len: 168 time: 0.1242537 Nov 24 16:15:44.979753 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2732d007-37a0-4d84-a564-4b066f30c41c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c28cad4d-ba75-42f0-ad9f-624aaa7a5c44,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:45.029147 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40170) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:45.072084 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-625a3569-45fb-432a-bf41-68d7339f7256 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=4ca913475fb04e7a8ea75d95578c8b84&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0416012 Nov 24 16:15:45.074593 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40172) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:45.123721 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:45.145445 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:45.196535 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:45.199132 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:45.204613 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/d88dd602-022a-482c-8611-ddb6fa63acd4 HTTP/1.1" status: 204 len: 168 time: 0.1288106 Nov 24 16:15:45.214755 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed99612-7cde-4610-97a4-b8d94733c336 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d88dd602-022a-482c-8611-ddb6fa63acd4,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:45.217528 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 838c6cdf-c823-41c0-8fd9-23daaee0913f no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:15:45.245070 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 838c6cdf-c823-41c0-8fd9-23daaee0913f {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:15:45.245428 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 838c6cdf-c823-41c0-8fd9-23daaee0913f not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:15:45.246118 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 3d045898-91ac-4634-b168-eeaa9c87f097 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:15:45.271571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 3d045898-91ac-4634-b168-eeaa9c87f097 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:15:45.271571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 3d045898-91ac-4634-b168-eeaa9c87f097 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:15:45.271571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:15:45.296574 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:15:45.296927 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device eccb7fc3-c7bb-4584-bf2d-4aeb52a9573b not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:15:46.974446 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40260) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:47.010182 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:15:47.113875 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5684e8cf-7d9e-431b-8792-15dca61ea0a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.188427 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5684e8cf-7d9e-431b-8792-15dca61ea0a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.193120 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5684e8cf-7d9e-431b-8792-15dca61ea0a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.231454 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5684e8cf-7d9e-431b-8792-15dca61ea0a1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=bd9ee21a442445e2880163f07ab4cb6f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2564323 Nov 24 16:15:47.232590 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5684e8cf-7d9e-431b-8792-15dca61ea0a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b53dfb05-fe85-4a64-8c71-2e817dd855dc,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:47.234101 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40266) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:47.282320 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.304548 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.350101 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.352770 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.353949 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b53dfb05-fe85-4a64-8c71-2e817dd855dc HTTP/1.1" status: 204 len: 168 time: 0.1188810 Nov 24 16:15:47.361359 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e15328e-bfa9-4bde-8361-8b33951341db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b53dfb05-fe85-4a64-8c71-2e817dd855dc,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:47.609997 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40272) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:47.626625 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdc1f33e-5714-429b-82cb-38cd12354966 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.701323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdc1f33e-5714-429b-82cb-38cd12354966 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.704604 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdc1f33e-5714-429b-82cb-38cd12354966 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.742695 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-fdc1f33e-5714-429b-82cb-38cd12354966 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=673cb23351bb410d9ac500413474d76d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1315444 Nov 24 16:15:47.743536 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc1f33e-5714-429b-82cb-38cd12354966 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f265053-ff71-4965-875e-241a85e8f3cf,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:47.746499 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40274) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:47.797349 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.820350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.866860 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.869461 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:47.870601 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9f265053-ff71-4965-875e-241a85e8f3cf HTTP/1.1" status: 204 len: 168 time: 0.1229603 Nov 24 16:15:47.878469 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f1def1-228d-4669-ac70-f85299e5ea30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f265053-ff71-4965-875e-241a85e8f3cf,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:48.614373 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d785b9ad-38fb-4632-b902-94f252fec441 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:49.882692 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40360) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:49.988185 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37009806-c565-49bc-a831-781567d16f7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.064870 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37009806-c565-49bc-a831-781567d16f7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.069813 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-37009806-c565-49bc-a831-781567d16f7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.107704 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-37009806-c565-49bc-a831-781567d16f7b admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f05a39659d6b49e5b2f5a8ca352e5e52&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2239082 Nov 24 16:15:50.108575 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37009806-c565-49bc-a831-781567d16f7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1db50920-9638-44c1-ab0e-2a8206a3c80a,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:50.110505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40364) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:50.162401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.182927 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.227543 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.230331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.231475 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/1db50920-9638-44c1-ab0e-2a8206a3c80a HTTP/1.1" status: 204 len: 168 time: 0.1199701 Nov 24 16:15:50.239353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ca8e4a-56a3-4e37-bda9-572c8f838efb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1db50920-9638-44c1-ab0e-2a8206a3c80a,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:50.492782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40370) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:50.507318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e764f122-4636-4adc-b72e-1b8d68c3cda3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.580367 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e764f122-4636-4adc-b72e-1b8d68c3cda3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.584520 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e764f122-4636-4adc-b72e-1b8d68c3cda3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.622217 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e764f122-4636-4adc-b72e-1b8d68c3cda3 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=12ceb7dc3dab4492b9edb0d7356d9160&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1283000 Nov 24 16:15:50.623156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e764f122-4636-4adc-b72e-1b8d68c3cda3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d18ccc71-d3e6-4be7-85fa-35613ddd5b39,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:50.624936 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40372) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:50.678187 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.704814 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.751742 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.755215 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.762782 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/d18ccc71-d3e6-4be7-85fa-35613ddd5b39 HTTP/1.1" status: 204 len: 168 time: 0.1317563 Nov 24 16:15:50.771742 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466b25ff-94cf-43d2-96ac-2285eb7cfe5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d18ccc71-d3e6-4be7-85fa-35613ddd5b39,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:51.038049 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40394) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:51.149347 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7c67546a-4af7-4f27-9c3f-98016df7689f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.230056 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7c67546a-4af7-4f27-9c3f-98016df7689f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.235346 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-7c67546a-4af7-4f27-9c3f-98016df7689f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.275534 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-7e3ac6cf-0c94-4ebf-b8eb-f8b1a70f9cc9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.276118 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c67546a-4af7-4f27-9c3f-98016df7689f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f43f99dd-5d49-4021-ab3b-82ff2ed55be9,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:51.283537 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40406) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:51.283939 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-7c67546a-4af7-4f27-9c3f-98016df7689f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c9d0555e39854fa5a8a8f31569945688&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2435212 Nov 24 16:15:51.336337 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.358417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.409232 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.412006 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.415844 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f43f99dd-5d49-4021-ab3b-82ff2ed55be9 HTTP/1.1" status: 204 len: 168 time: 0.1291773 Nov 24 16:15:51.420945 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d486a1-fa81-436b-9c31-5656982dc47f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f43f99dd-5d49-4021-ab3b-82ff2ed55be9,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:51.770311 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40424) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:51.783738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b39dad66-ef68-48ba-bf94-cdeda97ece06 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.865354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b39dad66-ef68-48ba-bf94-cdeda97ece06 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.869787 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b39dad66-ef68-48ba-bf94-cdeda97ece06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.908285 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b39dad66-ef68-48ba-bf94-cdeda97ece06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=227c7b5a-9f7e-4f56-82f5-e4d587b472ca,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:51.916963 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b39dad66-ef68-48ba-bf94-cdeda97ece06 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=30bd20d68bd94a019ba91b28252a657d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1432614 Nov 24 16:15:51.917539 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40428) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:51.918398 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40430) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:51.965319 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:51.986888 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.027163 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1b5980ca-16f5-4a3d-8ef4-e6ad4fb4f4e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.034301 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.037487 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.041254 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/227c7b5a-9f7e-4f56-82f5-e4d587b472ca HTTP/1.1" status: 204 len: 168 time: 0.1205168 Nov 24 16:15:52.046285 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70c503b9-6e04-4d97-a746-13234365d1dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=227c7b5a-9f7e-4f56-82f5-e4d587b472ca,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:52.109984 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1b5980ca-16f5-4a3d-8ef4-e6ad4fb4f4e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.114631 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-1b5980ca-16f5-4a3d-8ef4-e6ad4fb4f4e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.159291 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-1b5980ca-16f5-4a3d-8ef4-e6ad4fb4f4e7 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=33536517e7a44443ae7e058caa51984f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2398293 Nov 24 16:15:52.160158 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b5980ca-16f5-4a3d-8ef4-e6ad4fb4f4e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75eeb11f-8293-47b7-9b98-4d45b121ce67,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:52.162712 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40438) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:52.215979 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.237454 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.298323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.301673 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.306230 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/75eeb11f-8293-47b7-9b98-4d45b121ce67 HTTP/1.1" status: 204 len: 168 time: 0.1398113 Nov 24 16:15:52.314175 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfae138-e1a0-421e-97c6-a4caf46baf09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75eeb11f-8293-47b7-9b98-4d45b121ce67,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:52.670193 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:54.339774 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:54.486736 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:54.618029 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-cc28fac7-22a0-4844-8533-52d8f7f918ae tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/networks?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0298657 Nov 24 16:15:54.797893 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-9fbe5a29-155e-4fe6-941f-685c56f86371 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:54.799257 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-9fbe5a29-155e-4fe6-941f-685c56f86371 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1755154 Nov 24 16:15:54.814737 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-5c963a29-8c53-46db-abd0-826f7358baca tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/quotas/c0e147459fcd40c79d08ae9c01f7657d HTTP/1.1" status: 200 len: 375 time: 0.0089493 Nov 24 16:15:54.845041 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-f14f0999-59af-47e6-8373-9973e5cc9038 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249159 Nov 24 16:15:55.005513 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-61b5a0d2-0b76-483d-b5f7-778cb0a990f0 req-8c64f3d1-1cff-4218-9a7a-e256c709fa9f tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0297494 Nov 24 16:15:56.101020 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-52d285cd-f60a-4bd1-ac46-a792c1b7deea req-c5baa3ac-b13d-47f7-8126-7c0c9f9bf534 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0301812 Nov 24 16:15:57.196573 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-61b876c0-f8ba-4e82-a195-e71df85e316e req-3fdcaf32-b7d7-4719-a4a4-524060a34953 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0263720 Nov 24 16:15:58.292565 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0dac5c40-268d-456f-a64b-37b96be2b06d req-e56d6d84-1e9f-4efa-9cc4-48c0c63850d2 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0271609 Nov 24 16:15:58.786904 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-cd9b3a29-937a-449d-ac3f-906dfd1173af tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "GET /v2.0/networks?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0311093 Nov 24 16:15:58.972874 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-61b5a5bf-4223-4c77-ab0a-0a08ee05face tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:58.974472 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-61b5a5bf-4223-4c77-ab0a-0a08ee05face tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1822233 Nov 24 16:15:58.990160 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Request body: {'port': {'device_id': '78562530-30d1-4369-972e-a3163737ddc3', 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90', 'admin_state_up': True, 'tenant_id': 'c0e147459fcd40c79d08ae9c01f7657d'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:15:59.096990 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Made reservation on behalf of c0e147459fcd40c79d08ae9c01f7657d for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:15:59.100960 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.109551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.185576 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.189492 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.251727 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Pushing event updated for resources: {'SecurityGroup': ['ID=670ce4ba-9207-4127-9b64-0cc86d007558,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:59.320867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Allocated IP 192.168.233.155 (5fbcb32b-e15a-4ebf-b876-b0b96814fc90/9180217c-0963-48ea-b509-33d79eecb7f8/1d243d6e-8ba5-4a7d-8c23-424e8d461fb7) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:15:59.404681 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-80a34d04-338a-4d2a-9710-1dcd79cbef3c req-d9fa86a0-4771-4c8d-92b3-6993e96d0345 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0422411 Nov 24 16:15:59.486708 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.526724 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.573791 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:15:59.577517 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:15:59.580086 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:15:59.625713 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Pushing event updated for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:59.649474 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:59.650629 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.670409 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-e87b1dd8-0af6-46c9-ba70-b0f49f8b5ce7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6843548 Nov 24 16:15:59.682417 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-42b3f0af-5eca-4363-857c-40f6f14b1fa3 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:15:59.683072 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-42b3f0af-5eca-4363-857c-40f6f14b1fa3 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056002 Nov 24 16:15:59.804154 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Request body: {'port': {'device_id': '78562530-30d1-4369-972e-a3163737ddc3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:15:59.856579 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-4811c41b-53f3-4fef-adcf-69dc280d006a None None] Provisioning complete for port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:15:59.857248 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4811c41b-53f3-4fef-adcf-69dc280d006a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.865542 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:59.894977 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-4811c41b-53f3-4fef-adcf-69dc280d006a None None] Port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:00.145659 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:00.153234 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:00.165827 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Transition to ACTIVE for port object 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:16:00.169405 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:00.240442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Pushing event updated for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:00.296202 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Attempting to bind port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:00.296588 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Attempting to bind port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:00.296918 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Attempting to bind port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 on network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:00.302551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 on network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:16:00.302961 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Attempting to bind port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 on network 5fbcb32b-e15a-4ebf-b876-b0b96814fc90 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:00.308418 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:00.308754 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Checking segment: {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:00.309169 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Bound using segment: {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:00.309653 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Bound port: 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '57dddaa3-fafd-4ae7-8b73-837589e44fd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1030, 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:00.310009 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:00.374923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:00.377915 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:00.382621 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:00.416916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:00.417606 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:00.418959 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] 10.222.0.71 "PUT /v2.0/ports/1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 HTTP/1.1" status: 200 len: 1098 time: 0.7269149 Nov 24 16:16:00.419404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:00.421668 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75b9b942-00ef-4974-a4fe-563580a2f666" -d '{"events": [{"name": "network-changed", "server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:00.458831 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0525633a-f6f2-4a47-9060-dfa91c96ed3f service neutron] Pushing event updated for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:00.534428 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-cac442b3-fcaa-4c21-b97d-e70384e78aaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:00.536544 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-cac442b3-fcaa-4c21-b97d-e70384e78aaf service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 1101 time: 0.0746543 Nov 24 16:16:00.587772 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c614e084-8582-425e-ba83-72ad0e255e7b req-0a1f0cdb-d5cd-41eb-9111-7a7546b117ed tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:00.589342 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c614e084-8582-425e-ba83-72ad0e255e7b req-0a1f0cdb-d5cd-41eb-9111-7a7546b117ed tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 948 time: 0.0979781 Nov 24 16:16:00.590828 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-507a7982-e6c7-4e11-b6bf-924b297ed91c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.155&port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 HTTP/1.1" status: 200 len: 217 time: 0.0468383 Nov 24 16:16:00.622376 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d x-openstack-request-id: req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:00.622671 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:00.622929 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:00.623327 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7', 'status': 'completed', 'code': 200} Nov 24 16:16:00.682737 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c614e084-8582-425e-ba83-72ad0e255e7b req-e2a5edf1-7dc3-4724-9dbe-811fd9246899 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868564 Nov 24 16:16:00.684217 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-14988870-d211-44e0-8cf4-9adc43829a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:00.685761 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-14988870-d211-44e0-8cf4-9adc43829a89 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9180217c-0963-48ea-b509-33d79eecb7f8 HTTP/1.1" status: 200 len: 843 time: 0.0800140 Nov 24 16:16:00.731251 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-19e0781a-5308-477e-942f-d77141277e9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:00.732730 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-19e0781a-5308-477e-942f-d77141277e9c service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5fbcb32b-e15a-4ebf-b876-b0b96814fc90&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0397446 Nov 24 16:16:00.819704 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-32c3b732-2352-4171-b9b1-db3e04792ff8 service neutron] 10.222.0.71 "GET /v2.0/networks/5fbcb32b-e15a-4ebf-b876-b0b96814fc90?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796561 Nov 24 16:16:00.910435 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-95964d7b-ee0d-4580-850c-d5669b5003e0 req-c78576d7-57a2-4780-965d-da49e4556d6c service neutron] 10.222.0.71 "GET /v2.0/networks/5fbcb32b-e15a-4ebf-b876-b0b96814fc90?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831289 Nov 24 16:16:00.999236 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4824220f-5984-450d-bf6b-c197591c3f13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:01.000622 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4824220f-5984-450d-bf6b-c197591c3f13 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 1101 time: 0.0422163 Nov 24 16:16:01.093193 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-f029a72a-f7be-43b8-876a-1401dd78b9e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:01.094663 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-f029a72a-f7be-43b8-876a-1401dd78b9e6 service neutron] 10.222.0.71 "GET /v2.0/networks?id=5fbcb32b-e15a-4ebf-b876-b0b96814fc90 HTTP/1.1" status: 200 len: 871 time: 0.0873647 Nov 24 16:16:01.134831 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-56c526dd-b186-4cd2-bf05-ce407997e3cc service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.155&port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 HTTP/1.1" status: 200 len: 217 time: 0.0328832 Nov 24 16:16:01.185731 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4b899a1d-24f7-4df7-b8f6-e5ea9fae6018 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:01.187182 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4b899a1d-24f7-4df7-b8f6-e5ea9fae6018 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9180217c-0963-48ea-b509-33d79eecb7f8 HTTP/1.1" status: 200 len: 843 time: 0.0455470 Nov 24 16:16:01.241737 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-ba0b6525-88ba-4768-917b-2f335ac1b94e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:01.243233 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-ba0b6525-88ba-4768-917b-2f335ac1b94e service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=5fbcb32b-e15a-4ebf-b876-b0b96814fc90&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0483449 Nov 24 16:16:01.335455 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-7e00d3f4-261a-4311-91f9-d9a936924590 service neutron] 10.222.0.71 "GET /v2.0/networks/5fbcb32b-e15a-4ebf-b876-b0b96814fc90?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837336 Nov 24 16:16:01.430341 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-7fad6871-29ed-475b-bf01-f78f6edbd48a service neutron] 10.222.0.71 "GET /v2.0/networks/5fbcb32b-e15a-4ebf-b876-b0b96814fc90?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876994 Nov 24 16:16:01.800122 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 req-0862edb8-9aee-4c48-a499-6f05b29c0086 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:01.801831 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 req-0862edb8-9aee-4c48-a499-6f05b29c0086 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 948 time: 0.0509641 Nov 24 16:16:01.848504 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 req-ece8ad8e-bb9f-41e3-a9cf-100bdebfbe72 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399809 Nov 24 16:16:02.532362 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40602) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:02.638824 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-48aba573-6e91-4e46-b9cd-11dc12da2282 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.710722 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-48aba573-6e91-4e46-b9cd-11dc12da2282 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.714628 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-48aba573-6e91-4e46-b9cd-11dc12da2282 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.753107 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-48aba573-6e91-4e46-b9cd-11dc12da2282 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=26112961637a4a2295b83024117dd149&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2195513 Nov 24 16:16:02.754794 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48aba573-6e91-4e46-b9cd-11dc12da2282 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6fd24ec-a6d6-4912-9599-36464ae5ad25,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:02.757234 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40606) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:02.804567 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.825866 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.875346 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.878056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:02.879320 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b6fd24ec-a6d6-4912-9599-36464ae5ad25 HTTP/1.1" status: 204 len: 168 time: 0.1210771 Nov 24 16:16:02.892496 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef35c773-264c-4ccc-a285-4acdf3e4f9f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6fd24ec-a6d6-4912-9599-36464ae5ad25,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:02.973551 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 req-da198e6f-6a59-4bbe-8cd8-519e82296fc6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:02.975438 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 req-da198e6f-6a59-4bbe-8cd8-519e82296fc6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 948 time: 0.0515921 Nov 24 16:16:03.026792 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 req-74ae5aad-dd5f-45b8-af80-bc6da87833d6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456486 Nov 24 16:16:03.526381 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40630) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:03.628548 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1378381455-network', 'tenant_id': '7ae2d50102bf491986834edf07a6a868'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:03.651774 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Made reservation on behalf of 7ae2d50102bf491986834edf07a6a868 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:03.654867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.664863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.739309 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.743336 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.769716 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1010} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:16:03.776070 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=300087a9-aaaf-42c3-8a12-e2ed85b9c55a,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:03.782039 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.782483 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Added segment 4f483b91-e552-422c-aad1-7b8f845efd1f of type vlan for network e94d2a4c-106b-44d2-b8a7-a2440253d60c Nov 24 16:16:03.826592 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.851692 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.852619 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:03.853348 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.867387 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:16:03.885211 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.3577011 Nov 24 16:16:03.888196 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40634) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:03.893690 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Request body: {'subnet': {'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1378381455-subnet', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:03.915837 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Made reservation on behalf of 7ae2d50102bf491986834edf07a6a868 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:03.917416 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e736e1-bdb5-41da-a5ec-ff3e45511733 admin admin] Pushing event updated for resources: {'Network': ['ID=e94d2a4c-106b-44d2-b8a7-a2440253d60c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:03.919737 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:03.944555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:16:04.022057 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:04.036690 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7', 'network_id': '5fbcb32b-e15a-4ebf-b876-b0b96814fc90', 'port_id': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7', 'mac_address': 'fa:16:3e:22:67:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1030, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9180217c-0963-48ea-b509-33d79eecb7f8', 'ip_address': '192.168.233.155'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:16:04.079552 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.093494 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:04.096686 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.114576 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:04.118854 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.168118 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:04.175225 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.175755 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.176805 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.177227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.177575 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.178823 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.179598 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.179598 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.179839 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.180514 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.180514 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.180819 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:04.199802 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3f57000-e20c-491a-8f21-32857a544343,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:04.217989 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a11b60b-0e93-42b5-b417-2ace55c100f1 req-8471709c-0b34-4e17-91e8-e50c6ae788c1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:04.219857 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7a11b60b-0e93-42b5-b417-2ace55c100f1 req-8471709c-0b34-4e17-91e8-e50c6ae788c1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 949 time: 0.1154962 Nov 24 16:16:04.221081 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:04.221437 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Network hostable DHCP agents. Network: e94d2a4c-106b-44d2-b8a7-a2440253d60c, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:16:04.263864 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:16:04.283687 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, e94d2a4c-106b-44d2-b8a7-a2440253d60c) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:04.289019 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7a11b60b-0e93-42b5-b417-2ace55c100f1 req-ab354144-f8d3-4dd5-aefa-9cafe797e093 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628197 Nov 24 16:16:04.291939 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:04.292393 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.295164 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11183ac0-c3e6-4f1a-b44c-ef944e1e9724 None None] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:04.310126 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-e19c574e-30bd-4482-b823-8b6f64254a2a admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4202285 Nov 24 16:16:04.312799 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40638) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:04.317343 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:04.340545 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.341962 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.400903 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.494215 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['1d243d6e-8ba5-4a7d-8c23-424e8d461fb7'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:16:04.651841 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:16:04.652649 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.787046 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.833515 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Allocated IP 172.20.0.2 (e94d2a4c-106b-44d2-b8a7-a2440253d60c/d3f57000-e20c-491a-8f21-32857a544343/826a8de4-a432-4d3d-b640-55bdbafac32e) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:04.981948 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.987360 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.990614 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.008201 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.028988 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:05.035358 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:05.038295 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:05.047763 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Pushing event updated for resources: {'Port': ['ID=826a8de4-a432-4d3d-b640-55bdbafac32e,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:05.103867 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Attempting to bind port 826a8de4-a432-4d3d-b640-55bdbafac32e on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:05.104245 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Attempting to bind port 826a8de4-a432-4d3d-b640-55bdbafac32e by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:05.104609 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Attempting to bind port 826a8de4-a432-4d3d-b640-55bdbafac32e on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:05.109629 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:05.110004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:05.110409 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.110806 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Bound using segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:05.111277 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Bound port: 826a8de4-a432-4d3d-b640-55bdbafac32e, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:05.111657 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.118983 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Allocated IP 172.27.0.103 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/59d65189-e006-4b9c-8a20-8e5ec7f687a6) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:05.181154 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] For port 826a8de4-a432-4d3d-b640-55bdbafac32e, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:05.184806 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] For port 826a8de4-a432-4d3d-b640-55bdbafac32e, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=826a8de4-a432-4d3d-b640-55bdbafac32e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:05.190591 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.230305 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.252281 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf78fda-1744-4c58-b407-5272fc460c25 None None] Pushing event updated for resources: {'Port': ['ID=826a8de4-a432-4d3d-b640-55bdbafac32e,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:05.278738 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.318148 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:05.323874 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:05.326538 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:05.361276 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Pushing event updated for resources: {'Port': ['ID=59d65189-e006-4b9c-8a20-8e5ec7f687a6,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:05.430051 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6477700-d752-43ff-9381-6391d4bb9550 req-70a9bdd4-20d6-452f-89b2-5c5c2412758e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:05.431260 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6477700-d752-43ff-9381-6391d4bb9550 req-70a9bdd4-20d6-452f-89b2-5c5c2412758e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 949 time: 0.0546739 Nov 24 16:16:05.520420 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6477700-d752-43ff-9381-6391d4bb9550 req-c70ce62a-9205-4a4d-bed6-74806266eb19 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781753 Nov 24 16:16:05.628504 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.821475 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.868494 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:05.925439 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:16:05.930422 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:05.930796 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:05.958910 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102787) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:16:06.014721 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.039867 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:06.042240 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4213e0c0-7e8f-4e98-903c-4e76481129cc" -d '{"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-plugged", "status": "completed", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:06.056327 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:06.062730 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.077668 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:16:06.094364 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2de7f476-77f7-4286-a95c-c91a0104cc4b x-openstack-request-id: req-2de7f476-77f7-4286-a95c-c91a0104cc4b {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:06.094730 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-plugged", "status": "completed", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:06.094992 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-2de7f476-77f7-4286-a95c-c91a0104cc4b {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:06.095409 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7', 'code': 200} Nov 24 16:16:06.098360 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:16:06.102662 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.107173 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-583dedc6-e754-4131-b6a3-128e96176fe6 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.7906730 Nov 24 16:16:06.108075 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40644) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:06.126752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:06.127370 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:06.186323 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:06.250499 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4c13e04-1d33-45dd-adda-9740d09218a8 None None] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:06.282330 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:06.367031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd9c257-8a6c-423f-aa9e-d73a07d0d7aa req-a0ddfb2d-0ce2-438c-8a69-3c46386e9bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:06.368391 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7bd9c257-8a6c-423f-aa9e-d73a07d0d7aa req-a0ddfb2d-0ce2-438c-8a69-3c46386e9bc4 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 1103 time: 0.0859215 Nov 24 16:16:06.433003 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] Provisioning complete for port 826a8de4-a432-4d3d-b640-55bdbafac32e triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:06.433759 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.461390 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7bd9c257-8a6c-423f-aa9e-d73a07d0d7aa req-af85b674-0514-4dc4-bb48-4b8fbdc94c5a service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858090 Nov 24 16:16:06.642796 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.688064 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:05Z', 'revision_number': 3, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:06.694009 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] For port 826a8de4-a432-4d3d-b640-55bdbafac32e, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=826a8de4-a432-4d3d-b640-55bdbafac32e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:06.720421 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:16:06.720779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Updating router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:16:06.722909 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.771166 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:06.822669 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bbd29d3-5a0b-47ec-b805-916829e843ae None None] Pushing event updated for resources: {'Port': ['ID=826a8de4-a432-4d3d-b640-55bdbafac32e,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:06.824580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 req-2e056370-70c1-4d44-a4d8-073b22209d08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:06.826345 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 req-2e056370-70c1-4d44-a4d8-073b22209d08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 950 time: 0.0825102 Nov 24 16:16:06.911774 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 req-a788ddb9-ff15-451a-b424-fd1db6503e97 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768666 Nov 24 16:16:06.953126 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.106660 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-e0d49157-ca5a-4b99-bda7-22d548e64311 None None] Provisioning complete for port 826a8de4-a432-4d3d-b640-55bdbafac32e triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:07.107271 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-e0d49157-ca5a-4b99-bda7-22d548e64311 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.112919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Allocated IP 172.20.0.1 (e94d2a4c-106b-44d2-b8a7-a2440253d60c/d3f57000-e20c-491a-8f21-32857a544343/c8d53c1a-5321-4c74-a7d2-701ca6324a4a) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:07.226463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.255499 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 826a8de4-a432-4d3d-b640-55bdbafac32e up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:07.263612 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.271074 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.287825 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.315753 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:07.320829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:07.325208 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:07.328351 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Pushing event updated for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:07.361827 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94907e25-e624-41ec-9ab4-7647517c2960 None None] Pushing event updated for resources: {'Port': ['ID=59d65189-e006-4b9c-8a20-8e5ec7f687a6,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:07.366164 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Attempting to bind port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:07.366544 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Attempting to bind port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:07.367111 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Attempting to bind port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:07.368655 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.374951 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:07.375338 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:07.375743 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.376145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:07.376635 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Bound port: 59d65189-e006-4b9c-8a20-8e5ec7f687a6, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:07.377021 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.409672 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 826a8de4-a432-4d3d-b640-55bdbafac32e triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:07.410052 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.470520 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] For port 59d65189-e006-4b9c-8a20-8e5ec7f687a6, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:07.476755 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] For port 59d65189-e006-4b9c-8a20-8e5ec7f687a6, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=59d65189-e006-4b9c-8a20-8e5ec7f687a6,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:07.482607 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.511113 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.580742 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94907e25-e624-41ec-9ab4-7647517c2960 None None] Pushing event updated for resources: {'Port': ['ID=59d65189-e006-4b9c-8a20-8e5ec7f687a6,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:07.584326 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:07.584941 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:07.648218 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-bbee00c4-658b-425e-926f-6f7b481ed5bd None None] Provisioning complete for port c8d53c1a-5321-4c74-a7d2-701ca6324a4a triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:07.648508 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bbee00c4-658b-425e-926f-6f7b481ed5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.710325 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.715435 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.734732 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-bbee00c4-658b-425e-926f-6f7b481ed5bd None None] Port c8d53c1a-5321-4c74-a7d2-701ca6324a4a cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:07.740766 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:07.794805 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Pushing event updated for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:07.797164 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:07.891180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:07.892791 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:07.964629 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:08.003317 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39c41d80-0239-4d14-8c46-6d4a098fa25d None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:16:08.031151 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:16:08.057664 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e424ab88-4a75-4114-8762-389b8f4db4dd req-79d8a33a-c21b-4f83-930b-a140db50455e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:08.059258 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e424ab88-4a75-4114-8762-389b8f4db4dd req-79d8a33a-c21b-4f83-930b-a140db50455e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 950 time: 0.0633826 Nov 24 16:16:08.127614 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e424ab88-4a75-4114-8762-389b8f4db4dd req-f685ba42-507b-41b3-8bf5-5eb821411bfb tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587060 Nov 24 16:16:08.165160 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-d039c742-5041-41f9-917a-fa46c63a865b None None] Provisioning complete for port c8d53c1a-5321-4c74-a7d2-701ca6324a4a triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:08.165636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d039c742-5041-41f9-917a-fa46c63a865b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.166990 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:16:08.171119 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-55f9bd25-ebba-4c30-b355-f4cfd925a4b4 admin admin] 10.222.0.72 "PUT /v2.0/routers/eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0587099 Nov 24 16:16:08.213830 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-d039c742-5041-41f9-917a-fa46c63a865b None None] Port c8d53c1a-5321-4c74-a7d2-701ca6324a4a cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:08.453818 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8ad700-495b-4229-9d76-cde1f97b2e08 req-e0631737-28be-4ea7-90bc-6fdd243b43d8 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:08.455426 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb8ad700-495b-4229-9d76-cde1f97b2e08 req-e0631737-28be-4ea7-90bc-6fdd243b43d8 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 950 time: 0.0614531 Nov 24 16:16:08.516749 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fb8ad700-495b-4229-9d76-cde1f97b2e08 req-a77bbe0b-822a-42ef-a08d-f448e8181028 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535076 Nov 24 16:16:08.727510 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40670) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:08.732675 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-15430155-network', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:08.764597 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Made reservation on behalf of aca002fad1b1436093645ee6f6cbd831 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:08.766973 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.781464 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.867068 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.877606 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.906501 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1046} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:16:08.916937 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ad3fea5-51a4-4e3a-abf2-4fab045453ac,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:08.923795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.924170 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Added segment 6e8b2de5-c898-4d55-ad5e-0fb6d7c56723 of type vlan for network 32f222e2-cb5f-4dbb-a63a-596b38749221 Nov 24 16:16:08.966426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.994397 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:08.995975 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:08.996855 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.031408 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3027158 Nov 24 16:16:09.034388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40672) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:09.039443 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Request body: {'subnet': {'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-15430155-subnet', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:09.062759 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Made reservation on behalf of aca002fad1b1436093645ee6f6cbd831 for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:09.065297 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.072792 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816181cd-4e02-4798-94b4-de2e4856587e admin admin] Pushing event updated for resources: {'Network': ['ID=32f222e2-cb5f-4dbb-a63a-596b38749221,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:09.084418 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:16:09.256928 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 59d65189-e006-4b9c-8a20-8e5ec7f687a6 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:09.272487 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.321769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:09.322395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.329895 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b742b62-cf13-4ec7-95ee-ec6f148cce17,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:09.341710 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Checking segment: {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:09.342082 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Network hostable DHCP agents. Network: 32f222e2-cb5f-4dbb-a63a-596b38749221, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:16:09.358900 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:16:09.375123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 32f222e2-cb5f-4dbb-a63a-596b38749221) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:09.382647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:09.383409 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.398771 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beda66a8-accb-45c5-99c9-91de92d75a06 None None] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:09.405568 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-70bcdec5-154e-45c3-9a7b-49c102c4371c admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3663268 Nov 24 16:16:09.405568 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40674) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:09.409786 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:09.432663 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.433972 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.438622 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.489896 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.498085 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 59d65189-e006-4b9c-8a20-8e5ec7f687a6, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=59d65189-e006-4b9c-8a20-8e5ec7f687a6,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:09.512523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.598495 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=59d65189-e006-4b9c-8a20-8e5ec7f687a6,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:09.656042 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-32f222e2-cb5f-4dbb-a63a-596b38749221', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:16:09.657004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.689117 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.716481 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-400da76a-f45c-4b51-a8c1-90f62a363cfd req-08e7daaf-593a-4da1-9b45-843b1ca4769c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:09.720371 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-400da76a-f45c-4b51-a8c1-90f62a363cfd req-08e7daaf-593a-4da1-9b45-843b1ca4769c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 950 time: 0.0731351 Nov 24 16:16:09.789943 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-400da76a-f45c-4b51-a8c1-90f62a363cfd req-94001139-3cbb-4e79-bf06-e43ccc784dc5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/security-groups?id=670ce4ba-9207-4127-9b64-0cc86d007558&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638297 Nov 24 16:16:09.817068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Allocated IP 172.20.0.2 (32f222e2-cb5f-4dbb-a63a-596b38749221/5b742b62-cf13-4ec7-95ee-ec6f148cce17/a4e07669-bd78-48f3-a7e5-d72053ca6e55) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:09.849392 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-cc41ef88-46f5-4f94-a7d0-8195597029ee tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:09.851200 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-cc41ef88-46f5-4f94-a7d0-8195597029ee tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 950 time: 0.0543525 Nov 24 16:16:09.916116 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.943165 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.962930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Deleting port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:16:09.964798 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.979532 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:09.986473 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.021806 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:10.024702 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:10.028491 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:10.065523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Pushing event updated for resources: {'Port': ['ID=a4e07669-bd78-48f3-a7e5-d72053ca6e55,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:10.076703 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] For port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,segment=NetworkSegment(57dddaa3-fafd-4ae7-8b73-837589e44fd5),segment_id=57dddaa3-fafd-4ae7-8b73-837589e44fd5)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:10.077339 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.080425 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Allocated IP 172.27.0.32 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/dc213cc3-7cff-4a2f-a651-e00aef4da146) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:10.094803 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling delete_port for 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:16:10.103155 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Attempting to bind port a4e07669-bd78-48f3-a7e5-d72053ca6e55 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:10.103675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Attempting to bind port a4e07669-bd78-48f3-a7e5-d72053ca6e55 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:10.104137 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Attempting to bind port a4e07669-bd78-48f3-a7e5-d72053ca6e55 on network 32f222e2-cb5f-4dbb-a63a-596b38749221 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:10.109428 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:10.109929 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Checking segment: {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:10.110430 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.111072 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Bound using segment: {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:10.111501 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Bound port: a4e07669-bd78-48f3-a7e5-d72053ca6e55, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:10.111978 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.192613 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] For port a4e07669-bd78-48f3-a7e5-d72053ca6e55, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:10.196487 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] For port a4e07669-bd78-48f3-a7e5-d72053ca6e55, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=a4e07669-bd78-48f3-a7e5-d72053ca6e55,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:10.201206 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.211197 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.256376 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.256848 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.271864 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['1d243d6e-8ba5-4a7d-8c23-424e8d461fb7'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:16:10.294923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Pushing event deleted for resources: {'Port': ['ID=1d243d6e-8ba5-4a7d-8c23-424e8d461fb7,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:10.303121 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf176b0-aebf-4a8d-afcb-ecf4669cfdaa None None] Pushing event updated for resources: {'Port': ['ID=a4e07669-bd78-48f3-a7e5-d72053ca6e55,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:10.311652 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Pushing event updated for resources: {'Port': ['ID=dc213cc3-7cff-4a2f-a651-e00aef4da146,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:10.331039 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:10.332932 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:10.335293 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:10.346656 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] No DVR routers for this DVR port 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:16:10.350972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.356834 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 req-4c3e1323-62e8-4e8c-9094-be96c4696bf5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.71 "DELETE /v2.0/ports/1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 HTTP/1.1" status: 204 len: 173 time: 0.4998267 Nov 24 16:16:10.362024 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'name': 'network-vif-deleted', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:10.364999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45606078-7b6f-40cd-8a67-a1b9feb3fa22" -d '{"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-deleted", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:10.408143 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b x-openstack-request-id: req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:10.408326 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-deleted", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:10.408507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:10.408916 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78562530-30d1-4369-972e-a3163737ddc3', 'name': 'network-vif-deleted', 'tag': '1d243d6e-8ba5-4a7d-8c23-424e8d461fb7', 'status': 'completed', 'code': 200} Nov 24 16:16:10.443539 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:16:10.460258 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:10.461192 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:10.640072 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:10.716336 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.872205 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 2, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:10.905816 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:16:10.906175 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Updating router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 port c8d53c1a-5321-4c74-a7d2-701ca6324a4a binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:16:10.933481 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.935128 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:10.937489 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 req-25c7899d-add8-42b9-82f0-a5c31433d6d5 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /v2.0/ports?device_id=78562530-30d1-4369-972e-a3163737ddc3 HTTP/1.1" status: 200 len: 210 time: 0.0472970 Nov 24 16:16:11.273326 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.281261 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.370107 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102787) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:16:11.370706 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device a4e07669-bd78-48f3-a7e5-d72053ca6e55 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:11.390197 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Pushing event updated for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:11.411387 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.411831 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.412199 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.412542 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.412875 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.413232 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.413560 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.413882 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.414222 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.414550 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.414872 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.415203 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:11.421854 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Attempting to bind port c8d53c1a-5321-4c74-a7d2-701ca6324a4a on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:11.422232 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Attempting to bind port c8d53c1a-5321-4c74-a7d2-701ca6324a4a by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:11.422596 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Attempting to bind port c8d53c1a-5321-4c74-a7d2-701ca6324a4a on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:11.436316 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:11.436696 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:11.439162 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.439568 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Bound using segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:11.440056 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Bound port: c8d53c1a-5321-4c74-a7d2-701ca6324a4a, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:11.440473 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.447372 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port a4e07669-bd78-48f3-a7e5-d72053ca6e55 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:11.447793 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.523407 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-067f3bb1-c996-4d2e-aed0-9c657d041830 None None] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:11.528902 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] For port c8d53c1a-5321-4c74-a7d2-701ca6324a4a, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:11.533749 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] For port c8d53c1a-5321-4c74-a7d2-701ca6324a4a, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:11.541155 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.543751 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:16:11.566673 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.570763 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8eeb8666-08ae-4067-8ecf-5617fb703a8a admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.1620426 Nov 24 16:16:11.571397 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40682) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:11.617228 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:11.618210 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:11.659121 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Sync routers for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:16:11.677918 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b81cb4-3c76-4725-85f9-bd87150cffb9 None None] Pushing event updated for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:11.850690 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-c57f1848-0528-4a94-86c9-6a8af17cc9e9 None None] Provisioning complete for port a4e07669-bd78-48f3-a7e5-d72053ca6e55 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:11.851056 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c57f1848-0528-4a94-86c9-6a8af17cc9e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.854375 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.874330 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:11.875217 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:11.892784 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:11.966913 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port a4e07669-bd78-48f3-a7e5-d72053ca6e55, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=a4e07669-bd78-48f3-a7e5-d72053ca6e55,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:11.977759 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:11.978559 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 59d65189-e006-4b9c-8a20-8e5ec7f687a6 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:12.142447 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.157987 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:11Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:12.180939 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:12.215131 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2727174c-cfe3-42f1-9bee-41231d6554f1 None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:11Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:16:12.271541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=a4e07669-bd78-48f3-a7e5-d72053ca6e55,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:12.297848 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:12.298369 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.435622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Allocated IP 172.20.0.1 (32f222e2-cb5f-4dbb-a63a-596b38749221/5b742b62-cf13-4ec7-95ee-ec6f148cce17/f4a3ed40-460c-400c-bbfa-2e2503120f37) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:12.501199 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Provisioning complete for port c8d53c1a-5321-4c74-a7d2-701ca6324a4a triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:12.501768 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.547371 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:10Z', 'revision_number': 3, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:12.571345 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.577564 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Checking router: 041ba8d6-e5f1-480f-ae0e-3fd162f300ce for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:16:12.577916 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Updating router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce port dc213cc3-7cff-4a2f-a651-e00aef4da146 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:16:12.621613 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.624379 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.658631 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:12.662431 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:12.666253 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:12.719550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Pushing event updated for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:12.740888 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.769229 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.869285 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] For port c8d53c1a-5321-4c74-a7d2-701ca6324a4a, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:12.877482 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.930522 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:12.973839 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Provisioning complete for port a4e07669-bd78-48f3-a7e5-d72053ca6e55 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:12.974210 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.053426 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af42c68-f03d-46be-9556-39ae4186931a None None] Pushing event updated for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:13.155759 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.173600 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.217434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.224124 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.283849 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Pushing event updated for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:13.295915 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Attempting to bind port dc213cc3-7cff-4a2f-a651-e00aef4da146 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:13.296581 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Attempting to bind port dc213cc3-7cff-4a2f-a651-e00aef4da146 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:13.297263 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Attempting to bind port dc213cc3-7cff-4a2f-a651-e00aef4da146 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:13.312287 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28979cbe-74f8-453a-8755-f68bad82551b None None] Pushing event updated for resources: {'Port': ['ID=dc213cc3-7cff-4a2f-a651-e00aef4da146,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:13.320723 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c8d53c1a-5321-4c74-a7d2-701ca6324a4a up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:13.321229 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.330992 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:13.331632 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:13.332485 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.332906 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:13.333435 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Bound port: dc213cc3-7cff-4a2f-a651-e00aef4da146, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:13.333821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.391912 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-947a60be-e365-46e1-a5f0-ffb99c060c6d None None] Provisioning complete for port f4a3ed40-460c-400c-bbfa-2e2503120f37 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:13.392043 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-947a60be-e365-46e1-a5f0-ffb99c060c6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.435419 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:13.436884 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:13.465881 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] For port dc213cc3-7cff-4a2f-a651-e00aef4da146, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:13.471377 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] For port dc213cc3-7cff-4a2f-a651-e00aef4da146, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc213cc3-7cff-4a2f-a651-e00aef4da146,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:13.473942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-947a60be-e365-46e1-a5f0-ffb99c060c6d None None] Port f4a3ed40-460c-400c-bbfa-2e2503120f37 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:13.478436 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.544995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port c8d53c1a-5321-4c74-a7d2-701ca6324a4a triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:13.546097 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:13.594934 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28979cbe-74f8-453a-8755-f68bad82551b None None] Pushing event updated for resources: {'Port': ['ID=dc213cc3-7cff-4a2f-a651-e00aef4da146,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:13.602171 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:13.602798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:13.631226 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:16:13.778049 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:16:13.793012 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b10013bd-523f-4531-bfe6-003e9007c058 admin admin] 10.222.0.72 "PUT /v2.0/routers/041ba8d6-e5f1-480f-ae0e-3fd162f300ce/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2121398 Nov 24 16:16:13.805400 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:13.809148 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device a4e07669-bd78-48f3-a7e5-d72053ca6e55 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:14.012203 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:16:14.050085 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:16:14.050450 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:16:14.056778 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-d589f7f6-adfe-429a-b4b3-97d748ef1bad None None] Provisioning complete for port f4a3ed40-460c-400c-bbfa-2e2503120f37 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:14.057189 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d589f7f6-adfe-429a-b4b3-97d748ef1bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.157611 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-d589f7f6-adfe-429a-b4b3-97d748ef1bad None None] Port f4a3ed40-460c-400c-bbfa-2e2503120f37 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:14.216860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port a4e07669-bd78-48f3-a7e5-d72053ca6e55 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:14.217313 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.303695 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.382712 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'f4a3ed40-460c-400c-bbfa-2e2503120f37', 'name': '', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'mac_address': 'fa:16:3e:06:73:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 638, 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:12Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 2, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'subnets': [{'id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:14.412324 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04331ff3-c5aa-4930-8ff8-9c15fdccd7cf None None] The sync data for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi is: [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'f4a3ed40-460c-400c-bbfa-2e2503120f37', 'name': '', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'mac_address': 'fa:16:3e:06:73:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 638, 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:12Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 2, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'subnets': [{'id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:16:14.419760 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40866) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:14.425043 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-504417305', 'description': 'tempest-secgroup-smoke-504417305 description', 'project_id': '7ae2d50102bf491986834edf07a6a868'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:14.456495 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.540833 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.545707 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.584234 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d157481-120f-42c9-be9e-2b8cef9b61c9,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:14.589830 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.595147 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-b8318cb8-ef1a-498d-b6c0-56597b332b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1732986 Nov 24 16:16:14.595821 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40886) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:14.601382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:14.657150 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.728366 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.732965 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.755766 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eb97d509-1587-4840-adf0-bb26cf720b91,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:14.766036 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.767293 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-53a8b880-23c6-4e16-9f89-9d46e70cd988 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1704731 Nov 24 16:16:14.770852 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40898) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:14.775688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:14.807602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.874060 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.878294 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.898619 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1156515b-be69-42ae-b0bc-3088d4a7108f,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:14.906550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:14.910964 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-7eeb3926-894a-42fe-a4c3-90f09f802554 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1356130 Nov 24 16:16:14.911607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40904) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:14.915663 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:14.946523 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.020941 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.024908 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.048412 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8c8ffc76-5ca3-4ae8-94d4-72f483abc545,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:15.056917 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.058157 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a6165a1c-2969-4d5c-9fb1-7e50b6263ba9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1459231 Nov 24 16:16:15.060978 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 40912) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:15.065844 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:15.102615 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.220563 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.225392 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.268580 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22ceb14c-26d0-4f1d-a45f-76538fe7c2d5,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:15.279540 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.283800 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9b4639a3-bfd6-4c9e-bace-03cef3cf0ac5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2190616 Nov 24 16:16:15.285206 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40926) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:15.290057 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:15.320270 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.securitygroups_db [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Project 7ae2d50102bf491986834edf07a6a868 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:16:15.333696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.409756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.416005 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.433498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4720faef-a1b3-4013-9b88-10628291c87c,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:15.449066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.450296 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5caa24ce-c71f-4017-9070-e89d24020d0e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1638818 Nov 24 16:16:15.453134 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 40942) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:15.458013 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'security_group_rule': {'security_group_id': '2d157481-120f-42c9-be9e-2b8cef9b61c9', 'project_id': '7ae2d50102bf491986834edf07a6a868', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:15.487541 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.securitygroups_db [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Project 7ae2d50102bf491986834edf07a6a868 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:16:15.495983 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.563240 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.568598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.586455 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9a08f892-c50c-42ba-a7bd-450f9986fd2a,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:15.599114 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:15.603688 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-8ff80ca9-f1a2-4e51-9b77-df10b5615c44 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1465373 Nov 24 16:16:16.577565 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Sync routers for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:16:16.587704 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:16.588539 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:16.698150 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:16.839859 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41008) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:16.904351 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'f4a3ed40-460c-400c-bbfa-2e2503120f37', 'name': '', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'mac_address': 'fa:16:3e:06:73:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 638, 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:12Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 2, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'subnets': [{'id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:16.930299 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Checking router: 041ba8d6-e5f1-480f-ae0e-3fd162f300ce for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:16:16.930666 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Updating router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce port f4a3ed40-460c-400c-bbfa-2e2503120f37 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:16:16.959999 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:16.985431 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-7037c9d1-e58d-410b-97cf-5520e87adb61 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c0e147459fcd40c79d08ae9c01f7657d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1442387 Nov 24 16:16:16.987791 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41012) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:17.038833 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.063103 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.119199 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.122221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.123580 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/670ce4ba-9207-4127-9b64-0cc86d007558 HTTP/1.1" status: 204 len: 168 time: 0.1348367 Nov 24 16:16:17.132968 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3e0f063-146c-47df-b475-c454675e84fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=670ce4ba-9207-4127-9b64-0cc86d007558,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:17.247725 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.253868 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.296008 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc213cc3-7cff-4a2f-a651-e00aef4da146 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:17.323156 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7057fa13-2779-4782-8a47-43c484d497cf None None] Pushing event updated for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:17.385444 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Attempting to bind port f4a3ed40-460c-400c-bbfa-2e2503120f37 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:17.386080 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Attempting to bind port f4a3ed40-460c-400c-bbfa-2e2503120f37 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:17.386612 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Attempting to bind port f4a3ed40-460c-400c-bbfa-2e2503120f37 on network 32f222e2-cb5f-4dbb-a63a-596b38749221 {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:17.388865 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port dc213cc3-7cff-4a2f-a651-e00aef4da146 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:17.389283 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.392193 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:17.392913 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Checking segment: {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:17.393624 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.394391 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Bound using segment: {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:17.394927 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Bound port: f4a3ed40-460c-400c-bbfa-2e2503120f37, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1046, 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:17.395445 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.487076 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] For port f4a3ed40-460c-400c-bbfa-2e2503120f37, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:17.490622 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] For port f4a3ed40-460c-400c-bbfa-2e2503120f37, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=f4a3ed40-460c-400c-bbfa-2e2503120f37,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:17.492245 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.497674 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.519412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port dc213cc3-7cff-4a2f-a651-e00aef4da146, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc213cc3-7cff-4a2f-a651-e00aef4da146,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:17.526653 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.563683 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7057fa13-2779-4782-8a47-43c484d497cf None None] Pushing event updated for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:17.590607 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=dc213cc3-7cff-4a2f-a651-e00aef4da146,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:17.614352 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:17.614989 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:15:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:17.718585 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] Provisioning complete for port f4a3ed40-460c-400c-bbfa-2e2503120f37 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:17.719005 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.739346 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:17.827933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.869816 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] For port f4a3ed40-460c-400c-bbfa-2e2503120f37, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=f4a3ed40-460c-400c-bbfa-2e2503120f37,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:17.875015 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:17.930327 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc5cf04-f0d1-4482-8b2c-75766d3f7416 None None] Pushing event updated for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:17.992211 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'f4a3ed40-460c-400c-bbfa-2e2503120f37', 'name': '', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'mac_address': 'fa:16:3e:06:73:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 638, 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:12Z', 'updated_at': '2021-11-24T16:16:17Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'subnets': [{'id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:17.998114 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-469ddb4d-186b-4636-911e-2092c155e34d None None] Provisioning complete for port f4a3ed40-460c-400c-bbfa-2e2503120f37 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:17.998490 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-469ddb4d-186b-4636-911e-2092c155e34d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.016220 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41038) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:18.023698 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3e7e606-d61d-4d70-b687-eaa119f1c7ae None None] The sync data for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi is: [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'f4a3ed40-460c-400c-bbfa-2e2503120f37', 'name': '', 'network_id': '32f222e2-cb5f-4dbb-a63a-596b38749221', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'mac_address': 'fa:16:3e:06:73:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 638, 'fixed_ips': [{'subnet_id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:12Z', 'updated_at': '2021-11-24T16:16:17Z', 'revision_number': 4, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'subnets': [{'id': '5b742b62-cf13-4ec7-95ee-ec6f148cce17', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:16:18.134607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1779770708-network', 'tenant_id': '778d3476a1b6447c8b02c8eb73bfe48e'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:18.165396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Made reservation on behalf of 778d3476a1b6447c8b02c8eb73bfe48e for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:18.167803 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.176781 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.271082 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.276365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.304669 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1012} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:16:18.315775 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50651294-e5ec-4721-9850-5a0ebe553b4c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:18.322461 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.322809 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Added segment 5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a of type vlan for network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 Nov 24 16:16:18.366334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.393267 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.394271 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:18.394848 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.437479 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4164958 Nov 24 16:16:18.438301 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41044) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:18.444810 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Request body: {'subnet': {'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1779770708-subnet', 'tenant_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:18.466149 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd5ba7a-cf20-46f1-90b6-617f837b2b7f admin admin] Pushing event updated for resources: {'Network': ['ID=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:18.467669 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Made reservation on behalf of 778d3476a1b6447c8b02c8eb73bfe48e for: {'subnet': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:18.470843 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30258675'] for subnet, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.480056 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:16:18.618135 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-91cd330f-f330-4c61-81b0-bfba1bbb3ea2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.661353 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30799394', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30258625'] for subnet, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.720058 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=08cdf99d-c150-40d7-9342-0b7d6ba2d926,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:18.727599 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Checking segment: {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102787) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:18.727964 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Network hostable DHCP agents. Network: 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102787) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:16:18.745993 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102787) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:16:18.757751 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2) {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:18.762181 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:18.762840 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:18.767070 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01fbd696-1cc5-4f5a-b1b6-302cdd109b16 None None] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:18.785732 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3d9f53e8-3264-4f0f-9483-582482772dd8 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3462818 Nov 24 16:16:18.902676 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25cd151e-0bf4-4611-84df-e8deed66d71b None None] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:19.280138 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device f4a3ed40-460c-400c-bbfa-2e2503120f37 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:19.337224 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port f4a3ed40-460c-400c-bbfa-2e2503120f37 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:19.337533 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:19.423788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc213cc3-7cff-4a2f-a651-e00aef4da146 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:19.472752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port dc213cc3-7cff-4a2f-a651-e00aef4da146 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:19.473279 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:20.582155 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-9c94939f-06e6-4dd3-99b8-3ef1fef4b3be tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:20.583888 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-9c94939f-06e6-4dd3-99b8-3ef1fef4b3be tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 814 time: 0.1080995 Nov 24 16:16:20.601188 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-8126aa27-98d9-4a71-8fce-056641a763c1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/quotas/778d3476a1b6447c8b02c8eb73bfe48e HTTP/1.1" status: 200 len: 375 time: 0.0103571 Nov 24 16:16:20.635686 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-a2b247c0-235a-403e-98be-d2d88b429037 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0289490 Nov 24 16:16:20.697427 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-7072b76e-1737-4b68-b740-33271a4b64a5 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:16:20.698430 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-7072b76e-1737-4b68-b740-33271a4b64a5 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0561357 Nov 24 16:16:20.788862 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-9609ac72-3443-48c2-a56e-2a5be3c5e4f0 service neutron] 10.222.0.72 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841451 Nov 24 16:16:20.884727 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-1094068f-09a4-4448-bfc5-5201718465ca service neutron] 10.222.0.72 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0897229 Nov 24 16:16:21.044166 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f0d9ae86-8a25-4647-890d-9543cd277361 req-d196aad0-bde3-40c8-90d8-3ab3e42d7064 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0281818 Nov 24 16:16:21.281985 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c92f3dc8-3469-4014-bc37-cd6459c8d340 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:22.129975 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-008e829f-dc2a-4ef6-bb55-0c62fc371c1c req-1c21d882-a201-4da0-b793-5827ec93b40b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0282698 Nov 24 16:16:22.671863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:23.213668 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-11780dbc-b1ea-4fee-8a0f-8bb9a01e7ae4 req-89ff23fd-6b76-402e-91e6-1df4321eb856 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0310750 Nov 24 16:16:23.999913 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:16:24.302251 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2474232c-5185-4854-b764-355e2d6314e1 req-4b9039ff-b983-45e6-8480-fe787e8701cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0292180 Nov 24 16:16:24.345856 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:24.490942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:25.401548 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a209ff65-03b2-48c6-8919-b3940e6725b6 req-8d16c185-ae9b-4f09-9482-a9957f7b7242 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0269041 Nov 24 16:16:26.116940 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0874f6bb-1919-470e-9240-365eec1ebcd5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:26.119385 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0874f6bb-1919-470e-9240-365eec1ebcd5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 814 time: 0.1095824 Nov 24 16:16:26.134398 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Request body: {'port': {'device_id': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', 'admin_state_up': True, 'tenant_id': '778d3476a1b6447c8b02c8eb73bfe48e'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:26.255141 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Made reservation on behalf of 778d3476a1b6447c8b02c8eb73bfe48e for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:26.259380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:26.388075 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Allocated IP 172.20.0.8 (8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2/08cdf99d-c150-40d7-9342-0b7d6ba2d926/0adfe968-26c2-481a-8821-0e1906cc8f14) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:26.515501 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-16c33959-9e78-4c1a-bfb3-819f433f6782 req-8a5ba564-54ea-4c06-801c-10d837191f03 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0372462 Nov 24 16:16:26.567824 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:26.604475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:26.646093 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:26.651826 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:26.655480 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:26.681420 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Pushing event updated for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:26.708761 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:26.709498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:26.725933 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-4c7a61df-9b17-442f-ab39-58b4a83687a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5959032 Nov 24 16:16:26.811536 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Request body: {'port': {'device_id': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:26.875263 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.171095 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0adfe968-26c2-481a-8821-0e1906cc8f14 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:27.181865 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.198111 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Transition to ACTIVE for port object 0adfe968-26c2-481a-8821-0e1906cc8f14 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:16:27.201832 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.268407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Pushing event updated for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:27.350187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Attempting to bind port 0adfe968-26c2-481a-8821-0e1906cc8f14 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:27.350766 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Attempting to bind port 0adfe968-26c2-481a-8821-0e1906cc8f14 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:27.353063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Attempting to bind port 0adfe968-26c2-481a-8821-0e1906cc8f14 on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:27.361480 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Port 0adfe968-26c2-481a-8821-0e1906cc8f14 on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:16:27.362046 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Attempting to bind port 0adfe968-26c2-481a-8821-0e1906cc8f14 on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:27.371526 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 16, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:27.372350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Checking segment: {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:27.373011 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Bound using segment: {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:27.373799 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Bound port: 0adfe968-26c2-481a-8821-0e1906cc8f14, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:27.374416 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.461986 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:27.465323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0adfe968-26c2-481a-8821-0e1906cc8f14,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:27.470409 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.511423 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:27.512036 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.513453 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] 10.222.0.71 "PUT /v2.0/ports/0adfe968-26c2-481a-8821-0e1906cc8f14 HTTP/1.1" status: 200 len: 1093 time: 0.7065828 Nov 24 16:16:27.513893 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:27.516133 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca4e3280-4105-4892-b087-0c1d22700a23" -d '{"events": [{"name": "network-changed", "server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:27.547089 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d40d996-28e1-4d6e-942e-01e05b346f9d service neutron] Pushing event updated for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:27.611240 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 x-openstack-request-id: req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:27.611957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:27.612275 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:27.612978 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14', 'status': 'completed', 'code': 200} Nov 24 16:16:27.639941 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-ce1e2ff9-9dff-43f0-aa1f-284866240036 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:27.642546 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-ce1e2ff9-9dff-43f0-aa1f-284866240036 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 1096 time: 0.0766723 Nov 24 16:16:27.670762 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 req-3438bd37-a546-4879-93b4-bb79ed312c36 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:27.674201 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 req-3438bd37-a546-4879-93b4-bb79ed312c36 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 943 time: 0.0629911 Nov 24 16:16:27.693115 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-879ebcaf-cf03-417a-9019-33ed6dbc7e5e service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0adfe968-26c2-481a-8821-0e1906cc8f14 HTTP/1.1" status: 200 len: 217 time: 0.0406258 Nov 24 16:16:27.734067 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 req-4d38a625-dc1f-4622-9216-dd79573cb978 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535231 Nov 24 16:16:27.746250 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-5e1ac777-a3c6-4149-aa10-deeab53054a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:27.748154 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-5e1ac777-a3c6-4149-aa10-deeab53054a6 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 200 len: 854 time: 0.0485921 Nov 24 16:16:27.790257 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-43a02f19-7bd7-4173-860a-c9384564c1da service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329192 Nov 24 16:16:27.884026 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-33ed9236-87b7-4d4f-ac7a-9836bf1ce8ac service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864780 Nov 24 16:16:27.979179 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf req-84e990ea-bf17-40e7-aae9-3dd5365b759d service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880637 Nov 24 16:16:28.070378 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-9b6523c0-f169-4143-98c6-256546e56e30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:28.072132 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-9b6523c0-f169-4143-98c6-256546e56e30 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 1096 time: 0.0427115 Nov 24 16:16:28.171765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-09afbfcd-b25c-4446-abfe-597628931b79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:28.173295 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-09afbfcd-b25c-4446-abfe-597628931b79 service neutron] 10.222.0.71 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 916 time: 0.0943084 Nov 24 16:16:28.244777 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-bc8b3904-81b0-4d25-8855-d8dd762ce130 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0adfe968-26c2-481a-8821-0e1906cc8f14 HTTP/1.1" status: 200 len: 217 time: 0.0632532 Nov 24 16:16:28.295996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-c9b7901b-f34d-4130-9ec5-e7780b742da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:28.297531 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-c9b7901b-f34d-4130-9ec5-e7780b742da9 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 200 len: 854 time: 0.0461097 Nov 24 16:16:28.334671 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-7929d2fa-f8e3-42fb-9f64-8f58e2647adc service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279551 Nov 24 16:16:28.441764 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-d22481f0-bd2e-4468-8326-ea068274ebf3 service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0984433 Nov 24 16:16:28.545847 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-12e8d3b2-21b7-4e7a-9421-2b525ab9b599 service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958498 Nov 24 16:16:28.885386 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c146e6-7715-4a9e-91d4-cc667efff55a req-c4e47a3a-0f86-4061-8ac1-e6db7a487ed4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:28.888165 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-02c146e6-7715-4a9e-91d4-cc667efff55a req-c4e47a3a-0f86-4061-8ac1-e6db7a487ed4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 943 time: 0.0786910 Nov 24 16:16:28.958053 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-02c146e6-7715-4a9e-91d4-cc667efff55a req-29618e6c-74a2-4fd0-8565-d858b6d8e2fc tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638573 Nov 24 16:16:30.083025 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780112e6-6621-45dd-a332-711f35ff4811 req-df4e1570-e4cd-4eaa-b49d-ea129ed99dcd tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:30.084611 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-780112e6-6621-45dd-a332-711f35ff4811 req-df4e1570-e4cd-4eaa-b49d-ea129ed99dcd tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 943 time: 0.0526989 Nov 24 16:16:30.136118 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-780112e6-6621-45dd-a332-711f35ff4811 req-b45c5b83-edd8-4970-9027-27b34ad8b7d2 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451164 Nov 24 16:16:31.256043 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a983db2f-b2b0-45a3-8052-e35973a26019 req-198f984d-91cb-432b-a483-a6459c1eee0a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:31.258328 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a983db2f-b2b0-45a3-8052-e35973a26019 req-198f984d-91cb-432b-a483-a6459c1eee0a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 943 time: 0.0490515 Nov 24 16:16:31.304142 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a983db2f-b2b0-45a3-8052-e35973a26019 req-0beadb6f-329e-42ab-b9ce-244816b7b310 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401454 Nov 24 16:16:32.010318 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0adfe968-26c2-481a-8821-0e1906cc8f14 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:16:32.110605 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0adfe968-26c2-481a-8821-0e1906cc8f14,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:32.122113 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '0adfe968-26c2-481a-8821-0e1906cc8f14', 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', 'port_id': '0adfe968-26c2-481a-8821-0e1906cc8f14', 'mac_address': 'fa:16:3e:fb:04:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1012, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '08cdf99d-c150-40d7-9342-0b7d6ba2d926', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:16:32.160417 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:32.174241 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0adfe968-26c2-481a-8821-0e1906cc8f14 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:32.195086 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0adfe968-26c2-481a-8821-0e1906cc8f14,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:32.199244 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:32.245274 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:32.425477 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8b4092-86bb-4547-912e-c8f265da95cf req-0f770c88-5272-4155-ae12-daa5ceb05c82 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:32.426965 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2d8b4092-86bb-4547-912e-c8f265da95cf req-0f770c88-5272-4155-ae12-daa5ceb05c82 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 944 time: 0.0488861 Nov 24 16:16:32.478727 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2d8b4092-86bb-4547-912e-c8f265da95cf req-befdc253-5b76-4095-9c5c-db58227153d4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451970 Nov 24 16:16:32.579769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0adfe968-26c2-481a-8821-0e1906cc8f14'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:16:33.599040 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 req-324a5bde-5c66-439d-a554-d978a07b20f7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:33.600526 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 req-324a5bde-5c66-439d-a554-d978a07b20f7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 944 time: 0.0533085 Nov 24 16:16:33.647686 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 req-ae87e4ee-f9c0-4500-98d0-d2f085087106 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411119 Nov 24 16:16:34.040322 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0adfe968-26c2-481a-8821-0e1906cc8f14 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:34.089293 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 0adfe968-26c2-481a-8821-0e1906cc8f14 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:16:34.093008 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 0adfe968-26c2-481a-8821-0e1906cc8f14 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:34.093407 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:34.172422 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:34.194476 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:34.197209 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14f8c75c-2d30-4201-8f8c-90885ebd9304" -d '{"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-plugged", "status": "completed", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:34.209829 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0adfe968-26c2-481a-8821-0e1906cc8f14,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:34.215171 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:34.239490 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 x-openstack-request-id: req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:34.239948 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-plugged", "status": "completed", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:34.240190 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:34.240582 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14', 'code': 200} Nov 24 16:16:34.270886 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:34.409793 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b950e96-6b30-409c-8112-dfa0187c18a7 req-26e227f5-7606-4cd6-8af2-e47a6e871597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:34.411309 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1b950e96-6b30-409c-8112-dfa0187c18a7 req-26e227f5-7606-4cd6-8af2-e47a6e871597 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 1098 time: 0.0435398 Nov 24 16:16:34.456967 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1b950e96-6b30-409c-8112-dfa0187c18a7 req-d05cbc98-8876-4b02-8f57-55164bae0c8e service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387237 Nov 24 16:16:34.768782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 req-3a1bf98c-723d-44a2-aa2a-41578987156e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:34.770271 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 req-3a1bf98c-723d-44a2-aa2a-41578987156e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0521801 Nov 24 16:16:34.821569 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 req-3640552f-5f3d-45e4-8cba-400942e51e91 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453303 Nov 24 16:16:35.968647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e23ea5c-2d55-4647-be99-a06c36425c2b req-c9f0a58e-1e72-479e-9421-cd4d01108064 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:35.970194 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3e23ea5c-2d55-4647-be99-a06c36425c2b req-c9f0a58e-1e72-479e-9421-cd4d01108064 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0627100 Nov 24 16:16:36.021273 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3e23ea5c-2d55-4647-be99-a06c36425c2b req-a171cafb-7a5e-4e96-a3aa-7a5384e9bdb6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446162 Nov 24 16:16:37.147690 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 req-30c69365-be31-4214-b58d-b618520686a7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:37.150000 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 req-30c69365-be31-4214-b58d-b618520686a7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0531693 Nov 24 16:16:37.203946 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 req-48d109e9-b555-452b-a4d7-6b5c82358c06 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479846 Nov 24 16:16:37.379158 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-27e2cee8-856f-4799-80e2-5a4afd08b888 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-504417305&fields=id&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 267 time: 0.0513208 Nov 24 16:16:37.532219 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-8321da23-a9bf-4392-af92-d987aa7d67c1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:37.533803 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-8321da23-a9bf-4392-af92-d987aa7d67c1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1476738 Nov 24 16:16:37.553015 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-4000c2dd-ae10-4a09-8e6f-a54e206657b1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/quotas/7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 375 time: 0.0099154 Nov 24 16:16:37.615914 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f8580a82-9675-468e-8ece-4b4265e23b6f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0516808 Nov 24 16:16:37.797799 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-1d6c9388-d0d4-4e68-8ac3-0049dc3f6670 service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1639686 Nov 24 16:16:37.931206 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-af6ad23f-4e5d-4dd4-9ec3-285211c6bb1f service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236985 Nov 24 16:16:38.331010 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4af30676-e462-48af-9f1e-e918eec6a4ce req-ac58affb-b811-4d79-abde-c8de78711616 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 210 time: 0.0271118 Nov 24 16:16:39.327907 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-d2a0d7cf-e541-4961-82f6-8d2ff3d235df tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:39.329789 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-d2a0d7cf-e541-4961-82f6-8d2ff3d235df tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1091681 Nov 24 16:16:39.409628 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-ce3f072a-cc88-43c4-b72f-d5a84e6e1cb7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 379 time: 0.0691807 Nov 24 16:16:39.422710 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'port': {'device_id': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'admin_state_up': True, 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'security_groups': ['2d157481-120f-42c9-be9e-2b8cef9b61c9']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:39.437811 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-bf125832-4fc3-4130-b9e9-95e677e88c1d req-14e83fab-3b29-4f77-a36b-c69b4fa9c3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 210 time: 0.0272388 Nov 24 16:16:39.538640 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Made reservation on behalf of 7ae2d50102bf491986834edf07a6a868 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:16:39.542294 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:39.955196 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.20.0.7 (e94d2a4c-106b-44d2-b8a7-a2440253d60c/d3f57000-e20c-491a-8f21-32857a544343/d9123976-7ebf-4103-a11c-67a75901f6c9) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:40.103312 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.138614 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.191899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:40.198434 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:40.203310 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:40.230647 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:40.271817 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:40.272839 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.294516 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-c919950a-fb12-418c-9426-ec2b550d6d10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8756003 Nov 24 16:16:40.310869 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Request body: {'port': {'device_id': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:40.375991 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.479971 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-3ca31130-0774-4017-90c5-dbc305dbb733 None None] Provisioning complete for port d9123976-7ebf-4103-a11c-67a75901f6c9 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:40.480597 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3ca31130-0774-4017-90c5-dbc305dbb733 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.537565 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-3ca31130-0774-4017-90c5-dbc305dbb733 None None] Port d9123976-7ebf-4103-a11c-67a75901f6c9 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:16:40.641535 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f835f0-6911-4613-aef4-100681404f8b req-2482bfea-7dc0-4aa4-95eb-fef387f831ff tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:40.643024 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-06f835f0-6911-4613-aef4-100681404f8b req-2482bfea-7dc0-4aa4-95eb-fef387f831ff tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 931 time: 0.1122532 Nov 24 16:16:40.730927 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-06f835f0-6911-4613-aef4-100681404f8b req-696cb95e-b96c-4efc-81fe-74fb25e51506 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0814853 Nov 24 16:16:40.776259 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9123976-7ebf-4103-a11c-67a75901f6c9 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:40.784844 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.798017 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Transition to ACTIVE for port object d9123976-7ebf-4103-a11c-67a75901f6c9 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:16:40.802700 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:40.855169 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Pushing event updated for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:40.940356 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Attempting to bind port d9123976-7ebf-4103-a11c-67a75901f6c9 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:16:40.940693 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Attempting to bind port d9123976-7ebf-4103-a11c-67a75901f6c9 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:16:40.941058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Attempting to bind port d9123976-7ebf-4103-a11c-67a75901f6c9 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:40.946923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Port d9123976-7ebf-4103-a11c-67a75901f6c9 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:16:40.947250 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Attempting to bind port d9123976-7ebf-4103-a11c-67a75901f6c9 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:16:40.956440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 16, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:16:40.956779 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:16:40.957211 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Bound using segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:16:40.957655 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Bound port: d9123976-7ebf-4103-a11c-67a75901f6c9, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:16:40.958016 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:41.029462 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:16:41.032750 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=d9123976-7ebf-4103-a11c-67a75901f6c9,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:16:41.037574 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:41.072139 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.072804 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:41.074301 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] 10.222.0.71 "PUT /v2.0/ports/d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 1093 time: 0.7698669 Nov 24 16:16:41.076890 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:41.079309 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f60c317-4db3-4e1e-ad0c-0565817779fe" -d '{"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:41.118904 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1883bd9-50a5-4c19-b276-4593cef0663f service neutron] Pushing event updated for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:41.137297 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7460f90-178c-4fb5-a412-823c0ede3926 x-openstack-request-id: req-f7460f90-178c-4fb5-a412-823c0ede3926 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:41.137663 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:41.138001 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-f7460f90-178c-4fb5-a412-823c0ede3926 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:41.138488 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'status': 'completed', 'code': 200} Nov 24 16:16:41.198221 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-cc33a0ab-f4ed-4be5-94b0-a6874b55d50b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.201972 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-cc33a0ab-f4ed-4be5-94b0-a6874b55d50b service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1096 time: 0.0582252 Nov 24 16:16:41.253135 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-e25518da-b3c9-4428-bf85-bf205dd913b9 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 217 time: 0.0409780 Nov 24 16:16:41.322212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-de7412b9-3697-480c-9d8c-dbf8e761adc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.323702 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-de7412b9-3697-480c-9d8c-dbf8e761adc6 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0634067 Nov 24 16:16:41.383820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-5356dec3-bdb2-4b67-93be-afdb68b80a99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.385808 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-5356dec3-bdb2-4b67-93be-afdb68b80a99 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0540917 Nov 24 16:16:41.505868 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-9472fc7d-4907-4276-baf2-88b085abe48d service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1118298 Nov 24 16:16:41.619427 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 req-18c9f9dc-27c3-441d-af1b-7ca966b41f03 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055965 Nov 24 16:16:41.734453 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-0ef5a01a-d3cf-4354-8aca-587bf86fed2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.735982 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-0ef5a01a-d3cf-4354-8aca-587bf86fed2f service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1096 time: 0.0604894 Nov 24 16:16:41.884501 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-be62ca63-d725-4692-b36b-3adc22a72e94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.886799 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-be62ca63-d725-4692-b36b-3adc22a72e94 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.1427019 Nov 24 16:16:41.915436 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 req-bb9c6b66-2ee2-48ee-952c-2dcee6c8feac tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:41.917282 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 req-bb9c6b66-2ee2-48ee-952c-2dcee6c8feac tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0856249 Nov 24 16:16:41.968006 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-9a76e190-be8e-408a-8a6f-4299bfd8374e service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 217 time: 0.0695629 Nov 24 16:16:42.058042 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 req-7d4ce2ec-5653-4af7-96c8-ca9bdcc6d776 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0996253 Nov 24 16:16:42.060054 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-ae8ec9aa-4ae9-42b5-b99d-da2136490172 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:42.061860 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-ae8ec9aa-4ae9-42b5-b99d-da2136490172 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0858207 Nov 24 16:16:42.121134 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-2958999e-5493-4b32-a011-6567c850f0df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:42.122993 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-2958999e-5493-4b32-a011-6567c850f0df service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0505509 Nov 24 16:16:42.231578 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-ff74bcc1-4148-4e85-8bb1-8af8873d619a service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1004047 Nov 24 16:16:42.343488 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-0997e80f-cda3-43dc-b933-8a03db985175 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1032650 Nov 24 16:16:43.205206 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb09bfb-1af6-4727-b8a2-d6435442106b req-e98b1394-80a3-4366-a27b-0aa24f256bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:43.206780 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9fb09bfb-1af6-4727-b8a2-d6435442106b req-e98b1394-80a3-4366-a27b-0aa24f256bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0586772 Nov 24 16:16:43.265356 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9fb09bfb-1af6-4727-b8a2-d6435442106b req-5c9653ef-8d99-487b-b2fb-6fe59eb2970c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515831 Nov 24 16:16:44.280711 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:44.384155 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c req-de2e2465-78fc-444d-bc59-21a622be67d1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:44.385760 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c req-de2e2465-78fc-444d-bc59-21a622be67d1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0513914 Nov 24 16:16:44.452475 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c req-3398b180-ea77-4c89-9cd1-dfc27642170a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0607431 Nov 24 16:16:45.581071 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b1c2c5-c454-40c7-b51e-5178c984149f req-73975a1f-3eb9-4e67-bd67-f6c6229e3241 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:45.582606 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-80b1c2c5-c454-40c7-b51e-5178c984149f req-73975a1f-3eb9-4e67-bd67-f6c6229e3241 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0600314 Nov 24 16:16:45.635064 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-80b1c2c5-c454-40c7-b51e-5178c984149f req-516cb830-89ac-4102-ae6d-d31ed42f8512 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462801 Nov 24 16:16:46.751212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28477e94-ad79-4687-878c-bcda4c79e38f req-943f30f3-5704-48c8-b0e6-895904fcac9f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:46.752712 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-28477e94-ad79-4687-878c-bcda4c79e38f req-943f30f3-5704-48c8-b0e6-895904fcac9f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0492730 Nov 24 16:16:46.802547 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-28477e94-ad79-4687-878c-bcda4c79e38f req-84cf06a5-35be-46f0-b987-77369ec4590b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433197 Nov 24 16:16:47.918375 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e140715-f7a9-440b-b5db-fb6314d91bbe req-f23c846e-db5c-46a1-92d3-dbe6245a6258 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:47.919904 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e140715-f7a9-440b-b5db-fb6314d91bbe req-f23c846e-db5c-46a1-92d3-dbe6245a6258 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0493815 Nov 24 16:16:47.974244 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7e140715-f7a9-440b-b5db-fb6314d91bbe req-17ba33a7-9ba0-47b4-9aa7-116a6ff31fdc tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483494 Nov 24 16:16:48.620388 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-973ca41c-d288-4982-bca5-64e94114f0dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:49.093786 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e24641-15a9-470d-b44a-ba4617558feb req-0e62b7f3-40a0-46d8-8277-5ce62b75617c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:49.095187 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-49e24641-15a9-470d-b44a-ba4617558feb req-0e62b7f3-40a0-46d8-8277-5ce62b75617c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0536847 Nov 24 16:16:49.144128 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-49e24641-15a9-470d-b44a-ba4617558feb req-a2cada1e-71d5-41f0-961a-a37c1ff9fff2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429955 Nov 24 16:16:50.098609 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device d9123976-7ebf-4103-a11c-67a75901f6c9 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:16:50.197435 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=d9123976-7ebf-4103-a11c-67a75901f6c9,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:50.208862 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'port_id': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'mac_address': 'fa:16:3e:29:7a:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1010, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:16:50.248119 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:50.260948 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5140ca-cdf2-4982-8daf-204b80a5d579 req-d8eee04b-9425-4827-9070-8708effc2679 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:50.262496 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9d5140ca-cdf2-4982-8daf-204b80a5d579 req-d8eee04b-9425-4827-9070-8708effc2679 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 943 time: 0.0488491 Nov 24 16:16:50.264210 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9123976-7ebf-4103-a11c-67a75901f6c9 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:16:50.283294 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=d9123976-7ebf-4103-a11c-67a75901f6c9,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:50.287367 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:50.317058 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9d5140ca-cdf2-4982-8daf-204b80a5d579 req-532e55c4-8af0-4b25-961c-1925ed84337c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461433 Nov 24 16:16:50.337209 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:50.619142 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['d9123976-7ebf-4103-a11c-67a75901f6c9'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:16:51.284216 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d92bafc2-22a5-49cd-8611-bc4f69d8865c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:51.434706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029776a7-ed17-47c1-abda-beda4cbf2034 req-5ff18b95-f4a1-4c08-ab6b-d5274e948700 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:51.436078 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-029776a7-ed17-47c1-abda-beda4cbf2034 req-5ff18b95-f4a1-4c08-ab6b-d5274e948700 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 944 time: 0.0481274 Nov 24 16:16:51.499758 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-029776a7-ed17-47c1-abda-beda4cbf2034 req-706248a3-c778-4a8c-83f6-38f1e08dc027 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577583 Nov 24 16:16:52.119148 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device d9123976-7ebf-4103-a11c-67a75901f6c9 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:16:52.168352 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port d9123976-7ebf-4103-a11c-67a75901f6c9 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:16:52.172198 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port d9123976-7ebf-4103-a11c-67a75901f6c9 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:52.172567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:52.250267 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:52.272503 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:52.275273 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227" -d '{"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-plugged", "status": "completed", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:52.287926 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=d9123976-7ebf-4103-a11c-67a75901f6c9,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:16:52.292452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:52.317439 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-278176df-5433-4ac4-bbc3-f54f73a3e517 x-openstack-request-id: req-278176df-5433-4ac4-bbc3-f54f73a3e517 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:52.317734 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-plugged", "status": "completed", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:52.317993 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-278176df-5433-4ac4-bbc3-f54f73a3e517 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:52.318385 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'code': 200} Nov 24 16:16:52.346622 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:52.540441 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49039545-f677-4e12-a402-af8569fdcb32 req-d318112b-9568-4177-885c-31bfad8775ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:52.541962 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-49039545-f677-4e12-a402-af8569fdcb32 req-d318112b-9568-4177-885c-31bfad8775ef service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1098 time: 0.0411491 Nov 24 16:16:52.621789 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-49039545-f677-4e12-a402-af8569fdcb32 req-f95e2d9a-e0e7-43f6-97a5-3ece907e0571 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0725541 Nov 24 16:16:52.639408 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e59b01-92bb-4717-930e-03e1d80a64f7 req-115df04e-c375-43f8-9484-46ddafcd3149 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:52.640948 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-23e59b01-92bb-4717-930e-03e1d80a64f7 req-115df04e-c375-43f8-9484-46ddafcd3149 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0728288 Nov 24 16:16:52.674201 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:52.692915 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-23e59b01-92bb-4717-930e-03e1d80a64f7 req-8be4a178-1c94-41b4-842d-b41396b15ad3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455480 Nov 24 16:16:53.817075 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d2d605-48d2-4873-9ea2-7042110a0566 req-ea78b853-687d-42d3-aec8-d52b7fd0ea66 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:53.818552 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-89d2d605-48d2-4873-9ea2-7042110a0566 req-ea78b853-687d-42d3-aec8-d52b7fd0ea66 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0499489 Nov 24 16:16:53.868785 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-89d2d605-48d2-4873-9ea2-7042110a0566 req-c5aca24c-a60c-4b16-a869-7de9dd692be5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436678 Nov 24 16:16:54.348519 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:54.495019 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:54.982737 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efe8239-8b9c-4206-8304-65462316d48f req-27d70710-43ab-4ff8-9248-5d1c0ef7edfd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:54.984303 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3efe8239-8b9c-4206-8304-65462316d48f req-27d70710-43ab-4ff8-9248-5d1c0ef7edfd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0487881 Nov 24 16:16:55.033473 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-3efe8239-8b9c-4206-8304-65462316d48f req-62dffeb7-92cb-493d-9774-38dc3ff951fb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432265 Nov 24 16:16:55.151086 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d6654c-6c69-4b0e-8335-86983c420ad0 req-7b0cf8e0-e8cd-48e6-ad88-591e31b234c8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:55.152462 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f2d6654c-6c69-4b0e-8335-86983c420ad0 req-7b0cf8e0-e8cd-48e6-ad88-591e31b234c8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0539265 Nov 24 16:16:55.202408 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-f2d6654c-6c69-4b0e-8335-86983c420ad0 req-1da98cae-1519-408a-8b60-2fcacab814fe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440116 Nov 24 16:16:55.224252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41332) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:55.362191 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92faef04-8f98-43de-9b42-6d0d3a0fe490 tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:55.363700 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-92faef04-8f98-43de-9b42-6d0d3a0fe490 tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1093 time: 0.1384773 Nov 24 16:16:55.367158 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41336) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:55.371553 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'port_id': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:55.393249 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:55.488837 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:55.589682 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.27.0.147 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/e949b91c-7257-4852-9eff-eb9691661eaf) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:16:55.691898 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:55.726618 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:55.768533 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:16:55.773569 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:16:55.778205 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:16:55.781366 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=e949b91c-7257-4852-9eff-eb9691661eaf,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:55.809829 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.810182 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.810530 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.810872 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.811219 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.811551 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.811885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.812219 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.812550 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.812877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.813230 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:55.813555 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:56.390877 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:56.455420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:56.602067 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:56.606949 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:56.679521 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=e949b91c-7257-4852-9eff-eb9691661eaf,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:56.689369 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:56.790346 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 824de0e5-547d-422f-ba1f-5a10d2a418b6 associated. External IP: 172.27.0.147, port: d9123976-7ebf-4103-a11c-67a75901f6c9. Nov 24 16:16:56.994333 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:16:57.098572 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:16:57.108569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:16:57.118427 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:57.120172 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:57.120800 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:16:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:57.145671 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-d336b275-db8c-428e-821b-68d488e571ea tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7774940 Nov 24 16:16:57.146296 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:16:57.149451 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88a4f475-1678-4f7e-bb17-9aad926953f4" -d '{"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:16:57.187449 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:16:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 x-openstack-request-id: req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:16:57.187764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:16:57.188162 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:16:57.188662 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'status': 'completed', 'code': 200} Nov 24 16:16:57.258036 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-f2822152-f2f2-4ad0-8bcd-1a6dcb5cff40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:57.259481 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-f2822152-f2f2-4ad0-8bcd-1a6dcb5cff40 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1098 time: 0.0455086 Nov 24 16:16:57.353412 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-2a9e7ee4-79d2-458c-9edb-fa21489dd671 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:57.354932 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-2a9e7ee4-79d2-458c-9edb-fa21489dd671 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0870302 Nov 24 16:16:57.359268 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:57.424471 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-157b10ad-a797-4daa-bb1a-766e1d1821e6 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 999 time: 0.0621915 Nov 24 16:16:57.474928 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-ee89f48f-c958-4158-b006-b82381badeee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:57.476956 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-ee89f48f-c958-4158-b006-b82381badeee service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0440221 Nov 24 16:16:57.523826 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-00f95399-fec4-46cd-8b87-337f233ee965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:57.525306 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-00f95399-fec4-46cd-8b87-337f233ee965 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412662 Nov 24 16:16:57.584761 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '824de0e5-547d-422f-ba1f-5a10d2a418b6', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.147', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 659, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:29:7a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:16:56Z', 'updated_at': '2021-11-24T16:16:56Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:57.615107 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:16:57.620713 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-f843ff5a-a987-4f37-bd17-97b4b1a8149d service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872984 Nov 24 16:16:57.624355 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:16:57.624971 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:16:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:57.716108 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-1684f257-3367-4b67-ae0b-6baa8409510e service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873401 Nov 24 16:16:57.734477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:16:57.961711 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '824de0e5-547d-422f-ba1f-5a10d2a418b6', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.147', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 659, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:29:7a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:16:56Z', 'updated_at': '2021-11-24T16:16:56Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:16:57.991795 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9a8c481-1024-4c80-b854-52b8187b64bb None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '824de0e5-547d-422f-ba1f-5a10d2a418b6', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.147', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 659, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:29:7a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:16:56Z', 'updated_at': '2021-11-24T16:16:56Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:16:58.175127 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46fb3be8-fcde-429e-894c-5962e0e31c0d None None] New status for floating IP 824de0e5-547d-422f-ba1f-5a10d2a418b6: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:17:01.000514 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:17:14.279136 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:18.627110 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2bc8b95b-db3b-4a1c-af26-7cf4cd93d84a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:21.286494 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-000eb2cc-11d2-4403-87d5-e21423d776e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:22.673901 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.350025 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.493198 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.906451 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-208ffe50-b8b6-40db-a033-1618280f8d28 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0432377 Nov 24 16:17:24.997353 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-c28a4d68-d644-44f6-a5bd-d4d7b27fbed9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:25.003297 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-c28a4d68-d644-44f6-a5bd-d4d7b27fbed9 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 1098 time: 0.0483737 Nov 24 16:17:25.101132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-b649f7a7-bb18-45f5-b44c-f513142b902a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:25.102689 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-b649f7a7-bb18-45f5-b44c-f513142b902a service neutron] 10.222.0.71 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 916 time: 0.0841455 Nov 24 16:17:25.146466 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-fe508f7d-b53e-400d-9d5d-53936210d065 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0adfe968-26c2-481a-8821-0e1906cc8f14 HTTP/1.1" status: 200 len: 217 time: 0.0365160 Nov 24 16:17:25.196029 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-0a59b741-823d-4ec3-b486-75e4f1369006 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:25.198526 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-0a59b741-823d-4ec3-b486-75e4f1369006 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 200 len: 854 time: 0.0449591 Nov 24 16:17:25.230949 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-d97d76bb-d41e-4938-ab23-e852a4306377 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257437 Nov 24 16:17:25.326328 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-f312f588-4450-4c56-af13-efda7eb184cf service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884886 Nov 24 16:17:25.416092 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4ffe8a37-14f8-4dab-9680-a68eac505fba req-e21ac546-ca8f-4433-a5a9-1e1ef9750a7e service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827336 Nov 24 16:17:27.094375 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 req-2baa4826-a3f4-4f6b-a515-d62caec6d40e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:27.095729 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 req-2baa4826-a3f4-4f6b-a515-d62caec6d40e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0522337 Nov 24 16:17:27.143645 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 req-fa4cbd65-0e60-42e8-8334-1f29d75a6805 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414405 Nov 24 16:17:28.278874 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b696723-2e5f-4a02-b0db-aedd9e6f432b req-30f433ed-71e1-42c6-9a0e-206434ee13f0 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:28.280381 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3b696723-2e5f-4a02-b0db-aedd9e6f432b req-30f433ed-71e1-42c6-9a0e-206434ee13f0 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0676641 Nov 24 16:17:28.328258 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3b696723-2e5f-4a02-b0db-aedd9e6f432b req-8be6ca7d-a157-4de7-b555-833747ee8898 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417693 Nov 24 16:17:29.079031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-47b56f40-4df5-492d-9566-827893e99317 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:29.080473 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-47b56f40-4df5-492d-9566-827893e99317 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 945 time: 0.0487378 Nov 24 16:17:29.169380 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Deleting port 0adfe968-26c2-481a-8821-0e1906cc8f14 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:17:29.169703 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:29.259758 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] For port 0adfe968-26c2-481a-8821-0e1906cc8f14, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=0adfe968-26c2-481a-8821-0e1906cc8f14,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:17:29.260119 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:29.272502 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling delete_port for 0adfe968-26c2-481a-8821-0e1906cc8f14 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:17:29.407930 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:29.420363 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['0adfe968-26c2-481a-8821-0e1906cc8f14'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:17:29.433384 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7e8d3b00-a143-4481-9693-4c25045edce1 req-e872a464-ddfc-4b72-85ba-9012db86d608 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=7affc9c3-2c9c-4b32-91fc-e3a189845148 HTTP/1.1" status: 200 len: 210 time: 0.0376613 Nov 24 16:17:29.451511 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Pushing event deleted for resources: {'Port': ['ID=0adfe968-26c2-481a-8821-0e1906cc8f14,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:29.463999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.464354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.464706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.465063 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.465402 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.465739 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.466072 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.466401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.466731 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.467056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.467384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.467709 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:29.505165 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] No DVR routers for this DVR port 0adfe968-26c2-481a-8821-0e1906cc8f14 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:17:29.508078 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:29.511625 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 req-72691fbc-90a6-4f99-9387-7bf4d4dc8f3a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "DELETE /v2.0/ports/0adfe968-26c2-481a-8821-0e1906cc8f14 HTTP/1.1" status: 204 len: 173 time: 0.4252200 Nov 24 16:17:29.512080 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'name': 'network-vif-deleted', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:17:29.514431 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec183590-e6ff-4e50-9e83-7e8a7babd233" -d '{"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-deleted", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:17:29.554384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:17:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 x-openstack-request-id: req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:17:29.554686 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-deleted", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:17:29.555413 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:17:29.555413 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7affc9c3-2c9c-4b32-91fc-e3a189845148', 'name': 'network-vif-deleted', 'tag': '0adfe968-26c2-481a-8821-0e1906cc8f14', 'status': 'completed', 'code': 200} Nov 24 16:17:33.346315 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0adfe968-26c2-481a-8821-0e1906cc8f14 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:17:33.366796 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 0adfe968-26c2-481a-8821-0e1906cc8f14 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:17:33.367141 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 0adfe968-26c2-481a-8821-0e1906cc8f14 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:17:38.000412 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:17:41.440555 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-a6bf7a71-5627-402a-a432-bef549e97c88 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:41.442049 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-a6bf7a71-5627-402a-a432-bef549e97c88 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 814 time: 0.1026101 Nov 24 16:17:41.457300 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-dad28224-8115-4045-80c2-42fe24760a93 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/quotas/778d3476a1b6447c8b02c8eb73bfe48e HTTP/1.1" status: 200 len: 375 time: 0.0088265 Nov 24 16:17:41.493035 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-0485dff4-dc67-4cb7-a368-3d4bb72b734e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0304272 Nov 24 16:17:41.582034 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-86ffac40-6490-4357-b19c-931d4edaa3ce service neutron] 10.222.0.72 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819199 Nov 24 16:17:41.674097 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-26b1c002-669e-4f50-85f5-bd78dec28be4 service neutron] 10.222.0.72 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859714 Nov 24 16:17:41.834654 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-02c69fbf-957d-4739-b628-298e15eef6ce req-6f146d66-0ef6-41f0-ac8d-4c16c3742800 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 210 time: 0.0252268 Nov 24 16:17:42.785992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-1943e3b8-cf4d-4066-9d77-9af38ca69697 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:42.787524 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-1943e3b8-cf4d-4066-9d77-9af38ca69697 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 814 time: 0.1174519 Nov 24 16:17:42.801756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Request body: {'port': {'device_id': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', 'admin_state_up': True, 'tenant_id': '778d3476a1b6447c8b02c8eb73bfe48e'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:17:42.929316 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Made reservation on behalf of 778d3476a1b6447c8b02c8eb73bfe48e for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:17:42.933022 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:42.938414 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-22e91181-f30c-4c6b-a784-bfaf1bb34030 req-16ea29f8-5159-4d97-b680-13b89e4aaf70 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 210 time: 0.0311337 Nov 24 16:17:43.089586 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Allocated IP 172.20.0.13 (8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2/08cdf99d-c150-40d7-9342-0b7d6ba2d926/1ef0e071-bd08-48a0-80e3-0219af8862be) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:17:43.237893 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.270678 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.338862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:17:43.344049 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:17:43.351011 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:17:43.380288 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Pushing event updated for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:43.412957 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:43.413879 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.430995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-09586374-37e3-4da3-848e-48fbcfdfe649 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6330986 Nov 24 16:17:43.464572 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Request body: {'port': {'device_id': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:17:43.517760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.786440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1ef0e071-bd08-48a0-80e3-0219af8862be {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:17:43.795502 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.808327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Transition to ACTIVE for port object 1ef0e071-bd08-48a0-80e3-0219af8862be will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:17:43.811356 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:43.860781 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Pushing event updated for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:43.924532 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Attempting to bind port 1ef0e071-bd08-48a0-80e3-0219af8862be on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:17:43.924863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Attempting to bind port 1ef0e071-bd08-48a0-80e3-0219af8862be by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:17:43.925304 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Attempting to bind port 1ef0e071-bd08-48a0-80e3-0219af8862be on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:17:43.929610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Port 1ef0e071-bd08-48a0-80e3-0219af8862be on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:17:43.930185 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Attempting to bind port 1ef0e071-bd08-48a0-80e3-0219af8862be on network 8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:17:43.934689 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 17, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:17:43.935022 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Checking segment: {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:17:43.935405 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Bound using segment: {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:17:43.935825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Bound port: 1ef0e071-bd08-48a0-80e3-0219af8862be, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1012, 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:17:43.936171 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:44.003058 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:17:44.006834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1ef0e071-bd08-48a0-80e3-0219af8862be,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:17:44.010950 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:44.072177 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.072899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:44.074327 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] 10.222.0.71 "PUT /v2.0/ports/1ef0e071-bd08-48a0-80e3-0219af8862be HTTP/1.1" status: 200 len: 1094 time: 0.6143258 Nov 24 16:17:44.074758 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:17:44.077039 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1" -d '{"events": [{"name": "network-changed", "server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:17:44.112128 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832413eb-229c-4fb8-9245-c6baba5ea0d5 service neutron] Pushing event updated for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:44.118993 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:17:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de x-openstack-request-id: req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:17:44.119183 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:17:44.119289 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:17:44.119665 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be', 'status': 'completed', 'code': 200} Nov 24 16:17:44.127700 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0324171d-3c0a-4325-8dab-77071fc8175b req-b354ba8a-4493-440a-90f5-0868a5801fbf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.129186 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0324171d-3c0a-4325-8dab-77071fc8175b req-b354ba8a-4493-440a-90f5-0868a5801fbf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 944 time: 0.1157696 Nov 24 16:17:44.207119 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-4694c134-67f9-4e85-b2cc-e2beeb6dd648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.208650 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-4694c134-67f9-4e85-b2cc-e2beeb6dd648 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 1097 time: 0.0785744 Nov 24 16:17:44.216716 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0324171d-3c0a-4325-8dab-77071fc8175b req-916c529e-f424-47e8-9635-c1afb15618d6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786777 Nov 24 16:17:44.251724 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-bae90cbe-28db-45bf-88b7-8185bc40f1bf service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1ef0e071-bd08-48a0-80e3-0219af8862be HTTP/1.1" status: 200 len: 217 time: 0.0333624 Nov 24 16:17:44.303474 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91298c2-d694-49ce-953f-10642cba9005 req-8d93157b-d1d5-466e-9e7d-6e59294a0f57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.304936 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-8d93157b-d1d5-466e-9e7d-6e59294a0f57 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 200 len: 854 time: 0.0433931 Nov 24 16:17:44.309708 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:44.339756 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-7196178f-8554-4e02-b3c4-3495f7005a2c service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0281150 Nov 24 16:17:44.428570 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-881cc7a1-2ff8-4e16-8b17-01d37fb602ed service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790241 Nov 24 16:17:44.518709 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e91298c2-d694-49ce-953f-10642cba9005 req-326bb5f6-2ed9-44f0-a02e-264b17c0b011 service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828071 Nov 24 16:17:44.603021 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-1c628fe0-4d26-477a-96de-21285b592593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.604388 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-1c628fe0-4d26-477a-96de-21285b592593 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 1097 time: 0.0398452 Nov 24 16:17:44.696599 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-795b31fd-a550-4563-acb1-547a0dd490c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.698090 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-795b31fd-a550-4563-acb1-547a0dd490c2 service neutron] 10.222.0.71 "GET /v2.0/networks?id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 200 len: 916 time: 0.0855808 Nov 24 16:17:44.737965 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-acdc7e1f-76b3-42f1-b0b7-8798d927c0a0 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1ef0e071-bd08-48a0-80e3-0219af8862be HTTP/1.1" status: 200 len: 217 time: 0.0326977 Nov 24 16:17:44.785372 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-e9ed01f6-745e-4608-89d6-011f5fa78488 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:44.786816 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-e9ed01f6-745e-4608-89d6-011f5fa78488 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 200 len: 854 time: 0.0421348 Nov 24 16:17:44.819723 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-d9dbea9d-fdcd-4666-9815-b96f07167a43 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244770 Nov 24 16:17:44.908862 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-edae0864-2b13-45d3-880f-6ae1a9557a02 service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818732 Nov 24 16:17:44.997185 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-edc25830-35a8-4660-9902-d63b7496378d service neutron] 10.222.0.71 "GET /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0808349 Nov 24 16:17:45.339252 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5680f-869b-410e-8334-93ca919ff5c7 req-769a6013-a025-4bdf-8a24-85dba86e428c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:45.340714 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1b5680f-869b-410e-8334-93ca919ff5c7 req-769a6013-a025-4bdf-8a24-85dba86e428c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 944 time: 0.0495288 Nov 24 16:17:45.387502 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-b1b5680f-869b-410e-8334-93ca919ff5c7 req-fa681803-9bf0-4153-8ddb-f3d3f751215d tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403166 Nov 24 16:17:46.504139 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03ef702-0587-4a26-9421-666d0c1396f5 req-eebad0fc-2508-44a9-b6ce-57b4d0d53c1b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:46.505612 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b03ef702-0587-4a26-9421-666d0c1396f5 req-eebad0fc-2508-44a9-b6ce-57b4d0d53c1b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 944 time: 0.0505319 Nov 24 16:17:46.555372 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b03ef702-0587-4a26-9421-666d0c1396f5 req-cc80b068-c3f8-4654-9882-946d117113a5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434806 Nov 24 16:17:46.679428 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1ef0e071-bd08-48a0-80e3-0219af8862be details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:17:46.771304 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1ef0e071-bd08-48a0-80e3-0219af8862be,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:17:46.783099 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '1ef0e071-bd08-48a0-80e3-0219af8862be', 'network_id': '8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', 'port_id': '1ef0e071-bd08-48a0-80e3-0219af8862be', 'mac_address': 'fa:16:3e:30:f9:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1012, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '08cdf99d-c150-40d7-9342-0b7d6ba2d926', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:17:46.823116 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:46.836162 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ef0e071-bd08-48a0-80e3-0219af8862be {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:17:46.855551 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1ef0e071-bd08-48a0-80e3-0219af8862be,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:17:46.859436 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:46.905092 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:46.911979 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.912886 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.913263 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.913599 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.913937 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.914274 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.914608 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.914943 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.915275 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.915603 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.915933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:46.916255 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:47.176448 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['1ef0e071-bd08-48a0-80e3-0219af8862be'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:17:47.674661 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 req-0d7cfcd4-9738-4983-8137-e278bf13d9af tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:47.676134 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 req-0d7cfcd4-9738-4983-8137-e278bf13d9af tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 945 time: 0.0530424 Nov 24 16:17:47.723533 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 req-1e6b826b-e46b-41ac-9004-2fe2f3588d63 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408525 Nov 24 16:17:48.619037 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-615dceaf-631e-4a55-83ae-f4772b2dc2ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:48.686633 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1ef0e071-bd08-48a0-80e3-0219af8862be up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:17:48.735293 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 1ef0e071-bd08-48a0-80e3-0219af8862be completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:17:48.739445 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 1ef0e071-bd08-48a0-80e3-0219af8862be triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:17:48.739821 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:48.822386 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:48.839840 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221b2d96-3f22-472a-baef-a05ea7d1b3ec req-f1b51fc9-5a2a-45f5-b9cf-3a170078c844 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:48.841387 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-221b2d96-3f22-472a-baef-a05ea7d1b3ec req-f1b51fc9-5a2a-45f5-b9cf-3a170078c844 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 945 time: 0.0487413 Nov 24 16:17:48.844458 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:17:48.846704 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c015d3eb-93f7-424b-ba48-1de703878680" -d '{"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-plugged", "status": "completed", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:17:48.859742 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1ef0e071-bd08-48a0-80e3-0219af8862be,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:17:48.864591 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:48.892155 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-221b2d96-3f22-472a-baef-a05ea7d1b3ec req-6ee18ad7-3f3d-467e-a5b8-1db69e6d861a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443780 Nov 24 16:17:48.917503 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:49.014311 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:17:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cce0d7eb-deb4-4d35-b026-3866a267de1d x-openstack-request-id: req-cce0d7eb-deb4-4d35-b026-3866a267de1d {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:17:49.014606 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-plugged", "status": "completed", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:17:49.014858 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-cce0d7eb-deb4-4d35-b026-3866a267de1d {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:17:49.015254 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be', 'code': 200} Nov 24 16:17:49.201507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f011c0d6-f9be-46ce-8ab3-6da6176fa1ca req-dce87da9-94fe-447f-be28-bbac4989d8c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:49.203002 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f011c0d6-f9be-46ce-8ab3-6da6176fa1ca req-dce87da9-94fe-447f-be28-bbac4989d8c6 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 1099 time: 0.0423532 Nov 24 16:17:49.247051 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f011c0d6-f9be-46ce-8ab3-6da6176fa1ca req-2e855a98-f811-46e4-a309-dc05f2181f0e service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364904 Nov 24 16:17:50.006457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 req-72fbd5b4-cf56-4f84-8f89-da69e3275d1e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:50.007915 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 req-72fbd5b4-cf56-4f84-8f89-da69e3275d1e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0472405 Nov 24 16:17:50.054342 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 req-06d9ba04-dd6c-476b-a25e-d943dac46897 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405416 Nov 24 16:17:51.170904 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e69aac-1271-4a3c-a262-ecd3c074de09 req-7b8a4bca-e11d-4c60-b08b-6ad268059532 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:51.172395 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-34e69aac-1271-4a3c-a262-ecd3c074de09 req-7b8a4bca-e11d-4c60-b08b-6ad268059532 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0488272 Nov 24 16:17:51.221548 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-34e69aac-1271-4a3c-a262-ecd3c074de09 req-779a50ae-ced7-4434-ad65-33d19289d580 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426176 Nov 24 16:17:51.282759 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0d61d74f-a12b-4417-bc3e-cb3770e9f180 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:52.677716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:54.353420 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:54.499172 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:14.252392 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c1ab18-a42e-454d-9029-086b44649632 req-c483dc6d-be5e-481f-a274-d6cdcb6b2032 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:14.253782 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-46c1ab18-a42e-454d-9029-086b44649632 req-c483dc6d-be5e-481f-a274-d6cdcb6b2032 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0537527 Nov 24 16:18:14.302442 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-46c1ab18-a42e-454d-9029-086b44649632 req-5e350f19-4a00-4baa-9c17-35871fbe6457 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416329 Nov 24 16:18:14.312509 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:14.999629 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:18:15.420313 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 req-33365d81-3629-4304-b769-f104f69ac96b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:15.421802 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 req-33365d81-3629-4304-b769-f104f69ac96b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0477340 Nov 24 16:18:15.471228 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 req-5cfa969c-526d-429b-b345-a5209e4c4307 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432928 Nov 24 16:18:16.329081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-6c974741-468c-4a16-8f34-4b4768260a73 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:16.330576 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-6c974741-468c-4a16-8f34-4b4768260a73 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0502348 Nov 24 16:18:16.420331 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Deleting port 1ef0e071-bd08-48a0-80e3-0219af8862be {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:18:16.421070 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:16.592519 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02073e23-ab8c-417e-a921-bef3499d4d1a req-9e8a4863-12cb-4979-9f05-ad6380d6c340 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:16.594161 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-02073e23-ab8c-417e-a921-bef3499d4d1a req-9e8a4863-12cb-4979-9f05-ad6380d6c340 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/ports?device_id=3f2fe97a-bc77-447c-beeb-38569a4f8a66 HTTP/1.1" status: 200 len: 946 time: 0.0517352 Nov 24 16:18:16.645919 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-02073e23-ab8c-417e-a921-bef3499d4d1a req-12e8081d-9e36-45a6-b06a-e918bcad48f9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /v2.0/security-groups?id=50651294-e5ec-4721-9850-5a0ebe553b4c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454533 Nov 24 16:18:16.767545 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] For port 1ef0e071-bd08-48a0-80e3-0219af8862be, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=1ef0e071-bd08-48a0-80e3-0219af8862be,segment=NetworkSegment(5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a),segment_id=5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:16.767884 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:16.780925 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling delete_port for 1ef0e071-bd08-48a0-80e3-0219af8862be owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:18:16.905411 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:16.933728 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Pushing event deleted for resources: {'Port': ['ID=1ef0e071-bd08-48a0-80e3-0219af8862be,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:16.973379 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] No DVR routers for this DVR port 1ef0e071-bd08-48a0-80e3-0219af8862be on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:18:16.976217 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:16.979554 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 req-00d3822e-fcb7-4384-ade8-3f6691accb17 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.71 "DELETE /v2.0/ports/1ef0e071-bd08-48a0-80e3-0219af8862be HTTP/1.1" status: 204 len: 173 time: 0.6426392 Nov 24 16:18:16.979994 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'name': 'network-vif-deleted', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:18:16.982233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3829551d-78f1-4c75-888e-f6dffc854bd0" -d '{"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-deleted", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:18:17.020101 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:18:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ccd01ec-231e-4d1e-aa88-300babbacac4 x-openstack-request-id: req-3ccd01ec-231e-4d1e-aa88-300babbacac4 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:18:17.020401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-deleted", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:18:17.020661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-3ccd01ec-231e-4d1e-aa88-300babbacac4 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:18:17.021096 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f2fe97a-bc77-447c-beeb-38569a4f8a66', 'name': 'network-vif-deleted', 'tag': '1ef0e071-bd08-48a0-80e3-0219af8862be', 'status': 'completed', 'code': 200} Nov 24 16:18:18.620454 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-1ba6b4f1-91fc-4328-9c2d-5c63c5e19acc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:18.781582 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1ef0e071-bd08-48a0-80e3-0219af8862be no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:18:18.802310 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 1ef0e071-bd08-48a0-80e3-0219af8862be {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:18:18.802664 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 1ef0e071-bd08-48a0-80e3-0219af8862be not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:18:21.283553 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-53d9f2a8-9932-4938-a4f5-753fd3c73045 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:22.681016 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:24.355507 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:24.499834 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:25.950579 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-62be7d43-a63b-4d88-ad47-8ea3f2182128 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0437696 Nov 24 16:18:26.013394 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-7e748b5f-675a-449c-9f61-4abec4e049fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:26.014879 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-7e748b5f-675a-449c-9f61-4abec4e049fa service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1098 time: 0.0418570 Nov 24 16:18:26.114404 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-8a798970-4eb1-4a20-a35b-87907a4ce319 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:26.115837 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-8a798970-4eb1-4a20-a35b-87907a4ce319 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0802827 Nov 24 16:18:26.183886 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-a3e1317b-25e3-479b-a742-f248afed8641 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 1001 time: 0.0587461 Nov 24 16:18:26.236910 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-8a38a318-16b3-45f4-9330-f10d742b6afc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:26.238401 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-8a38a318-16b3-45f4-9330-f10d742b6afc service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0462506 Nov 24 16:18:26.284994 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-35046153-7caa-4a38-8024-d6d5f20c8547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:26.286485 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-35046153-7caa-4a38-8024-d6d5f20c8547 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407414 Nov 24 16:18:26.377965 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-2fe2d2e1-c041-4a91-8e57-c57f1a7726f6 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840704 Nov 24 16:18:26.470179 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a4ef5406-2613-4c10-8ba2-539e935f69c3 req-a63c8b92-7c87-47d3-a528-a4b160a08d38 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844364 Nov 24 16:18:42.779764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41798) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:42.824182 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Deleting subnet 08cdf99d-c150-40d7-9342-0b7d6ba2d926 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:18:42.827274 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:42.865597 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:42.903152 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:42.954422 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:42.982304 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=08cdf99d-c150-40d7-9342-0b7d6ba2d926,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:42.985323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:42.987998 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/08cdf99d-c150-40d7-9342-0b7d6ba2d926 HTTP/1.1" status: 204 len: 168 time: 0.2072344 Nov 24 16:18:42.990756 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41800) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:42.995184 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.995541 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.995887 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.996225 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.996562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.996894 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.997260 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:42.997679 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.002363 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.002706 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.003043 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.003374 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e7954e4-4f68-4cbc-a007-a807161735a4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.062760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.141846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.161054 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:43.169919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:43.170213 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e8db5d0-d7d5-4f3b-9d7a-b8e2f3a64d1a') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:43.179659 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.192740 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.199441 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Releasing vlan 1012 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:18:43.199828 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:18:43.201609 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:18:43.255677 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.261127 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.264277 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] 10.222.0.72 "DELETE /v2.0/networks/8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2 HTTP/1.1" status: 204 len: 168 time: 0.2725050 Nov 24 16:18:43.274694 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:43.281690 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.282053 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.282414 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.282708 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.283038 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.283369 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.283700 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.284025 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.284355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.284674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.284992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.285344 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b9bcc19-e704-459d-938b-20f75ac205e6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:43.417863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41804) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:43.460902 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f6eda7e0-d350-4d4d-bd58-550e0f3df2ff admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=778d3476a1b6447c8b02c8eb73bfe48e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0415990 Nov 24 16:18:43.463066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41806) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:43.510400 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.531093 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.578683 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.581160 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:43.582305 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/50651294-e5ec-4721-9850-5a0ebe553b4c HTTP/1.1" status: 204 len: 168 time: 0.1183462 Nov 24 16:18:43.590396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58f71d8-e690-456d-ad04-d7009bc4e3c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50651294-e5ec-4721-9850-5a0ebe553b4c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:44.318695 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41828) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:44.320024 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.450676 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-254194393-network', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:44.473092 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Made reservation on behalf of 0e05ec47caaa4b86ba407fd376f503c6 for: {'network': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:18:44.476284 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.487541 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.566405 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.570996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.599863 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1048} {{(pid=102788) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:18:44.613910 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3069819-a409-490d-88ab-ef875d0837ab,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:44.624079 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.624418 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.segments_db [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Added segment 456a71c0-a4d3-41a5-a40f-101b1f134ec0 of type vlan for network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca Nov 24 16:18:44.670000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.695795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.697119 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:44.698064 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:44.742348 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4203243 Nov 24 16:18:44.745114 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41832) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:44.750066 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Request body: {'subnet': {'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-254194393-subnet', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:44.791671 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ec88a8-7223-49f1-af8d-5b9b5f3a399d admin admin] Pushing event updated for resources: {'Network': ['ID=7adfa203-bbb1-4530-a8be-f1ebfa6654ca,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:44.802104 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:18:44.806505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Made reservation on behalf of 0e05ec47caaa4b86ba407fd376f503c6 for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:18:44.808870 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29486263'] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.005529 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29518501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29486213'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.060719 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9fe1060b-8118-4779-9a4d-1c167ac19e40,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:45.075765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Checking segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:45.076130 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Network hostable DHCP agents. Network: 7adfa203-bbb1-4530-a8be-f1ebfa6654ca, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:18:45.092719 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:18:45.102187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 7adfa203-bbb1-4530-a8be-f1ebfa6654ca) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:45.106511 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:45.107106 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.112011 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1db2aee-c89a-4b7f-8ea6-83110fc98fd5 None None] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:18:45.124642 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-5b976a0a-ae84-492e-9702-2fc15faca681 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3785105 Nov 24 16:18:45.127323 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41834) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:45.132304 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:45.154313 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.155308 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.214691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.268151 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:18:45.269220 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.354655 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.404853 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Allocated IP 172.20.0.2 (7adfa203-bbb1-4530-a8be-f1ebfa6654ca/9fe1060b-8118-4779-9a4d-1c167ac19e40/c0e21560-1d84-4518-a5d3-93ea08ceb2a2) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:45.550323 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.550834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.557348 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.571442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.592863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:45.597655 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:45.602041 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:45.611108 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Pushing event updated for resources: {'Port': ['ID=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:45.660087 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Attempting to bind port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:45.660446 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Attempting to bind port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:45.660803 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Attempting to bind port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 on network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:45.666917 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:45.667269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Checking segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:45.667675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.668066 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Bound using segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:45.668530 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Bound port: c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:45.668909 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.685251 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Allocated IP 172.27.0.161 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/5a738596-fe07-43db-a302-240d15d3f089) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:45.732157 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] For port c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:45.735221 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] For port c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:45.739008 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.793050 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.799234 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697b0435-c0ad-480e-8297-2fc45e834d02 None None] Pushing event updated for resources: {'Port': ['ID=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:45.833571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:45.870949 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:45.875942 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:45.879382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:45.903269 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Pushing event updated for resources: {'Port': ['ID=5a738596-fe07-43db-a302-240d15d3f089,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:46.145572 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:46.339130 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:46.471121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Router 1f3aee64-2d5d-4b44-a102-e57424d0c018 is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:18:46.580028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:18:46.590910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Sync routers for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:18:46.602729 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:46.603500 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:46.605620 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:46.607203 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-883adf9f-f6bc-422c-86c7-d016af601467 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.4786561 Nov 24 16:18:46.609737 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41836) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:46.644067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-696f5bf9-eb9d-4f63-ba77-3c8df74e6e33 None None] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:18:46.793723 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Provisioning complete for port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:46.794093 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:46.798007 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:47.082824 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.128917 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] For port c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:47.134947 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.180085 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:46Z', 'revision_number': 3, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:47.213545 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Checking router: 1f3aee64-2d5d-4b44-a102-e57424d0c018 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:18:47.213760 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Updating router 1f3aee64-2d5d-4b44-a102-e57424d0c018 port 5a738596-fe07-43db-a302-240d15d3f089 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:18:47.247209 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Pushing event updated for resources: {'Port': ['ID=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:47.254975 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.259230 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.259593 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.260031 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.260269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.260606 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.260941 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.261302 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.261675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.262017 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.262385 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.262593 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.262936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92ef11e7-dbae-4d80-ac0f-12f124eb360a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:47.284820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.380938 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c0e21560-1d84-4518-a5d3-93ea08ceb2a2 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:47.421518 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-bda0429d-ea01-468b-a1e8-fbf48043ec8b None None] Provisioning complete for port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:47.421903 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bda0429d-ea01-468b-a1e8-fbf48043ec8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.450680 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Allocated IP 172.20.0.1 (7adfa203-bbb1-4530-a8be-f1ebfa6654ca/9fe1060b-8118-4779-9a4d-1c167ac19e40/5bb1a2e0-3ca6-436b-b3eb-f131740dad8c) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:47.559842 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.596100 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.635207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:47.643429 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:47.648955 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:47.675498 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Pushing event updated for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:47.678056 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:47.679015 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.692797 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.840056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.859348 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.871955 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.943100 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Attempting to bind port 5a738596-fe07-43db-a302-240d15d3f089 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:47.943474 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Attempting to bind port 5a738596-fe07-43db-a302-240d15d3f089 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:47.943842 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Attempting to bind port 5a738596-fe07-43db-a302-240d15d3f089 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:47.953480 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2575325b-6577-4fcc-880b-c2b4c68dbe66 None None] Pushing event updated for resources: {'Port': ['ID=5a738596-fe07-43db-a302-240d15d3f089,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:47.956602 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-ceed8573-05ac-47a7-9f09-444b63db6b57 None None] Provisioning complete for port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:47.956986 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ceed8573-05ac-47a7-9f09-444b63db6b57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.960699 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:47.960699 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:47.961293 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:47.961716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:47.962089 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Bound port: 5a738596-fe07-43db-a302-240d15d3f089, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:47.962472 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.013458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.019546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.024755 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-ceed8573-05ac-47a7-9f09-444b63db6b57 None None] Port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:18:48.043527 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] For port 5a738596-fe07-43db-a302-240d15d3f089, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:48.046861 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] For port 5a738596-fe07-43db-a302-240d15d3f089, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5a738596-fe07-43db-a302-240d15d3f089,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:48.050643 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.091180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Pushing event updated for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:48.093679 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.109358 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:48.109980 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:48.149874 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2575325b-6577-4fcc-880b-c2b4c68dbe66 None None] Pushing event updated for resources: {'Port': ['ID=5a738596-fe07-43db-a302-240d15d3f089,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:48.187229 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:48.188667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:48.234249 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:48.309379 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Router 1f3aee64-2d5d-4b44-a102-e57424d0c018 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:18:48.425384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:18:48.431158 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a8d69ddc-103d-4482-a2c1-1bc343f1e39b admin admin] 10.222.0.72 "PUT /v2.0/routers/1f3aee64-2d5d-4b44-a102-e57424d0c018/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8203013 Nov 24 16:18:48.461255 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-acbaefcf-17a3-4862-b661-df94bcc542e4 None None] Provisioning complete for port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:48.461544 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-acbaefcf-17a3-4862-b661-df94bcc542e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.502134 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 2, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:48.503926 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-acbaefcf-17a3-4862-b661-df94bcc542e4 None None] Port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:18:48.531815 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-596f9170-45be-4f8d-93fc-1bd9852650e8 None None] The sync data for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi is: [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 2, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:18:48.622769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4bfe14d0-ed1c-4347-8488-3b93d26129b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.929084 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41852) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:48.934378 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-167906658-network', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:48.955636 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Made reservation on behalf of adb5033fc32a4c91a257ffffa45b41c6 for: {'network': 1} {{(pid=102787) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:18:48.958314 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for network, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:48.968638 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.048802 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.053325 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.082150 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1042} {{(pid=102787) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:18:49.088588 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55115b91-d828-441b-bfcb-cbdcdc468abf,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:49.098544 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.098984 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.segments_db [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Added segment 654244e8-cc72-4b31-be6c-c131be2ed667 of type vlan for network 71de30af-668e-4bd8-a00b-993a1a013f86 Nov 24 16:18:49.147144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8794868203825'] for network, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.186671 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356'] for network, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.188127 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:49.188916 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.226310 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.2960238 Nov 24 16:18:49.229268 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41854) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:49.236350 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Request body: {'subnet': {'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-167906658-subnet', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'ip_version': 4}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:49.270041 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4af6776-7788-4620-8c1e-0a3b809cb0d4 admin admin] Pushing event updated for resources: {'Network': ['ID=71de30af-668e-4bd8-a00b-993a1a013f86,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:49.273219 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Made reservation on behalf of adb5033fc32a4c91a257ffffa45b41c6 for: {'subnet': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:18:49.278153 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29486263'] for subnet, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.286558 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Network 71de30af-668e-4bd8-a00b-993a1a013f86 details requested by agent ovs-agent-dv-cinder-818994-2-iscsi with host dv-cinder-818994-2-iscsi {{(pid=102789) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:18:49.430636 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5a738596-fe07-43db-a302-240d15d3f089 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:49.499765 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 5a738596-fe07-43db-a302-240d15d3f089 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:49.500157 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.521771 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29518501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29486213'] for subnet, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.578423 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c13625a3-6727-4af5-969f-5fccba782446,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:49.586835 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.597827 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Checking segment: {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:49.598187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Network hostable DHCP agents. Network: 71de30af-668e-4bd8-a00b-993a1a013f86, hostable agents: ['09c6a53b-0aa6-49cc-b32d-59b39db425f7'], hosted agents: [] {{(pid=102788) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:18:49.609395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 5a738596-fe07-43db-a302-240d15d3f089, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5a738596-fe07-43db-a302-240d15d3f089,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:49.617707 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.618567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c0e21560-1d84-4518-a5d3-93ea08ceb2a2 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:49.619618 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Network 71de30af-668e-4bd8-a00b-993a1a013f86 is scheduled to be hosted by DHCP agent 09c6a53b-0aa6-49cc-b32d-59b39db425f7 with binding_index 1 {{(pid=102788) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:18:49.633939 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818994-2-iscsi, 71de30af-668e-4bd8-a00b-993a1a013f86) {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:49.639686 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:18:49.640466 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.664082 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e7166e19-26b1-4905-b611-3eaf31a0cfb0 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4309473 Nov 24 16:18:49.664381 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41856) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:49.669595 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:49.671581 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-228e32de-7f27-4531-8d9f-ef7b57e14f92 None None] Network 71de30af-668e-4bd8-a00b-993a1a013f86 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:18:49.691990 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33090002', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1923'] for router, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.692637 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33090558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33076378', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-33229261', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1928'] for router, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.755506 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.779472 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=5a738596-fe07-43db-a302-240d15d3f089,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:49.807335 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:49.807718 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.898620 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.933696 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf5abd58d-736e-54e0-8b4a-6a819bb21bd2-71de30af-668e-4bd8-a00b-993a1a013f86', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446'}]}} from dv-cinder-818994-2-iscsi. {{(pid=102789) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:18:49.934550 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.084519 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.db_base_plugin_common [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Allocated IP 172.20.0.2 (71de30af-668e-4bd8-a00b-993a1a013f86/c13625a3-6727-4af5-969f-5fccba782446/1f267ff1-80bb-422b-9189-0cb444f5d1eb) {{(pid=102789) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:50.102881 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.124263 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.234744 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Allocated IP 172.27.0.99 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/82980381-12d7-40f4-85fb-9f92c3734df5) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:50.240328 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks [] for port, precommit_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.246865 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396'] for port, after_create {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.284086 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Network 71de30af-668e-4bd8-a00b-993a1a013f86 is already hosted by enough agents. {{(pid=102789) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:50.290807 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.scheduler.base_scheduler [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Resources bound (agent type, host, resource id): {{(pid=102789) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:50.294257 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Received port after_create {{(pid=102789) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:50.301437 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Pushing event updated for resources: {'Port': ['ID=1f267ff1-80bb-422b-9189-0cb444f5d1eb,revision_number=1']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:50.352767 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.356730 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Attempting to bind port 1f267ff1-80bb-422b-9189-0cb444f5d1eb on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:50.357146 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Attempting to bind port 1f267ff1-80bb-422b-9189-0cb444f5d1eb by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:50.357538 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Attempting to bind port 1f267ff1-80bb-422b-9189-0cb444f5d1eb on network 71de30af-668e-4bd8-a00b-993a1a013f86 {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:50.362604 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:50.362983 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Checking segment: {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:50.363386 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.363781 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Bound using segment: {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:50.364246 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Bound port: 1f267ff1-80bb-422b-9189-0cb444f5d1eb, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:50.364629 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.388577 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.431438 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:50.434778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:50.435004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] For port 1f267ff1-80bb-422b-9189-0cb444f5d1eb, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:50.438943 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] For port 1f267ff1-80bb-422b-9189-0cb444f5d1eb, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=1f267ff1-80bb-422b-9189-0cb444f5d1eb,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:50.440537 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:50.445054 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Pushing event updated for resources: {'Port': ['ID=82980381-12d7-40f4-85fb-9f92c3734df5,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:50.445403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.508638 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259ada74-ec19-45b9-a714-71caeff47124 None None] Pushing event updated for resources: {'Port': ['ID=1f267ff1-80bb-422b-9189-0cb444f5d1eb,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:50.713525 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Sync routers for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:18:50.726600 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.726867 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:50.727509 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:50.845988 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:50.923932 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33090537', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33287969'] for router, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.047534 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 2, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:51.055023 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Router 4c19c2ef-4762-4c81-812a-5573ff4097d3 is scheduled to L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 with binding_index 1 {{(pid=102788) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:18:51.078635 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Checking router: 1f3aee64-2d5d-4b44-a102-e57424d0c018 for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:18:51.078998 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Updating router 1f3aee64-2d5d-4b44-a102-e57424d0c018 port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:18:51.105220 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.304547 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2e98128f-99d6-4553-a7d9-a9efa0bd294e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.412340 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.422304 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.468750 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:18:51.491343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Sync routers for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:18:51.500690 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Pushing event updated for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:51.506151 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:51.506696 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.507716 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:51.510610 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-989b9d9c-090f-41b7-a472-b959623fcd0f admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 1.8444650 Nov 24 16:18:51.513189 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41858) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:51.554180 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.554811 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.555174 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.555516 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.555853 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.556189 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.556519 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.556847 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.557221 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.557556 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.557878 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.558200 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102790) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:51.568133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1f267ff1-80bb-422b-9189-0cb444f5d1eb up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:51.589224 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Attempting to bind port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:51.589593 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Attempting to bind port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:51.590794 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Attempting to bind port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c on network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:51.595687 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:51.596075 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Checking segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:51.596479 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.596876 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Bound using segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:51.599119 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Bound port: 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:51.599544 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.687237 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] For port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:51.691521 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] For port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:51.699670 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.745823 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f142b3c-144f-47c1-857c-1fa30e35aa0e None None] Network 71de30af-668e-4bd8-a00b-993a1a013f86 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:18:51.758710 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:51.759347 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:51.829320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] Provisioning complete for port 1f267ff1-80bb-422b-9189-0cb444f5d1eb triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:51.829928 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.838658 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08788435-cc18-4c42-9a10-798ac019fd42 None None] Pushing event updated for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:51.901532 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:51.931835 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:52.000723 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:18:52.028817 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 1f267ff1-80bb-422b-9189-0cb444f5d1eb triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:52.029126 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.057269 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.143781 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:51Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:52.170914 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3acf7d4b-3077-4f89-99ff-83de68291381 None None] The sync data for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi is: [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:51Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:18:52.223674 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.239113 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Allocated IP 172.20.0.1 (71de30af-668e-4bd8-a00b-993a1a013f86/c13625a3-6727-4af5-969f-5fccba782446/26fb9dba-1538-4672-8935-c93d6cecaaf0) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:18:52.317322 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.342076 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] For port 1f267ff1-80bb-422b-9189-0cb444f5d1eb, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=1f267ff1-80bb-422b-9189-0cb444f5d1eb,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:52.355618 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.370860 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.414249 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.457685 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.db.api [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102789) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 16:18:52.457997 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG oslo_db.api [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 16:18:52.459412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc83009-ebb6-46c4-a773-e5a3f0160858 None None] Pushing event updated for resources: {'Port': ['ID=1f267ff1-80bb-422b-9189-0cb444f5d1eb,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:52.462292 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Network 71de30af-668e-4bd8-a00b-993a1a013f86 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:52.469120 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:52.474251 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:18:52.479184 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Pushing event updated for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:52.484795 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] Provisioning complete for port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:52.485199 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.515466 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:50Z', 'revision_number': 3, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:52.533936 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33087542'] for router_interface, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.549149 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Checking router: 4c19c2ef-4762-4c81-812a-5573ff4097d3 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:18:52.549434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Updating router 4c19c2ef-4762-4c81-812a-5573ff4097d3 port 82980381-12d7-40f4-85fb-9f92c3734df5 binding host dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:18:52.585065 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.688074 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.725384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.773426 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.788939 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] For port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:52.795913 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.881384 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.887026 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.903544 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3969d800-de31-4ecc-a070-84741ff67763 None None] Pushing event updated for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:52.947884 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2b685afb-fced-4faa-9898-4e55ffd15e31 None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:52.948551 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2b685afb-fced-4faa-9898-4e55ffd15e31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.962038 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33144774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33087642'] for router_interface, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.967857 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Pushing event updated for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:53.043417 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-2b685afb-fced-4faa-9898-4e55ffd15e31 None None] Port 26fb9dba-1538-4672-8935-c93d6cecaaf0 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:18:53.055523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5a738596-fe07-43db-a302-240d15d3f089 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:53.061006 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Network 71de30af-668e-4bd8-a00b-993a1a013f86 is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:18:53.062470 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:18:53.087639 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks [] for port, precommit_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.102651 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.107496 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2b685afb-fced-4faa-9898-4e55ffd15e31 None None] Provisioning complete for port 1f267ff1-80bb-422b-9189-0cb444f5d1eb triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:53.107863 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2b685afb-fced-4faa-9898-4e55ffd15e31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.194632 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Router 4c19c2ef-4762-4c81-812a-5573ff4097d3 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:18:53.204048 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409e7f51-e72f-4864-b13c-869761d8987d None None] Pushing event updated for resources: {'Port': ['ID=82980381-12d7-40f4-85fb-9f92c3734df5,revision_number=2']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:53.211998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Attempting to bind port 82980381-12d7-40f4-85fb-9f92c3734df5 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:53.211998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Attempting to bind port 82980381-12d7-40f4-85fb-9f92c3734df5 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:53.211998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Attempting to bind port 82980381-12d7-40f4-85fb-9f92c3734df5 on network b30ec751-e8b3-4e51-a19c-98cbd4d210ff {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:53.219569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 5a738596-fe07-43db-a302-240d15d3f089 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:53.219943 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.224169 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:53.224555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Checking segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102789) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:53.224957 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.225915 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Bound using segment: {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'} {{(pid=102789) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:53.226394 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.managers [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Bound port: 82980381-12d7-40f4-85fb-9f92c3734df5, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cf6f0fa-902a-4107-903f-7e946fa3729f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff'}}] {{(pid=102789) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:53.226787 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.317022 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:18:53.323271 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-200d9dca-80c3-48d6-8a29-a003876308d8 admin admin] 10.222.0.72 "PUT /v2.0/routers/4c19c2ef-4762-4c81-812a-5573ff4097d3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8088133 Nov 24 16:18:53.348546 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] For port 82980381-12d7-40f4-85fb-9f92c3734df5, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102789) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:53.354150 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] For port 82980381-12d7-40f4-85fb-9f92c3734df5, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=82980381-12d7-40f4-85fb-9f92c3734df5,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:53.358984 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.450549 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:53.451200 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:53.489930 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409e7f51-e72f-4864-b13c-869761d8987d None None] Pushing event updated for resources: {'Port': ['ID=82980381-12d7-40f4-85fb-9f92c3734df5,revision_number=3']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:53.675172 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1f267ff1-80bb-422b-9189-0cb444f5d1eb up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:53.681220 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-a59e8d3e-4a3b-4b2b-9c3c-7c097cc770b4 None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:53.681592 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a59e8d3e-4a3b-4b2b-9c3c-7c097cc770b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.764900 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-a59e8d3e-4a3b-4b2b-9c3c-7c097cc770b4 None None] Port 26fb9dba-1538-4672-8935-c93d6cecaaf0 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:18:53.767541 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:53.815609 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 1f267ff1-80bb-422b-9189-0cb444f5d1eb triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:53.815980 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.018401 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:54.072904 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '26fb9dba-1538-4672-8935-c93d6cecaaf0', 'name': '', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'mac_address': 'fa:16:3e:b9:05:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:52Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 2, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'subnets': [{'id': 'c13625a3-6727-4af5-969f-5fccba782446', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:54.102654 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b015b0e2-f0f7-43c7-9a0a-29e871a856df None None] The sync data for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi is: [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '26fb9dba-1538-4672-8935-c93d6cecaaf0', 'name': '', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'mac_address': 'fa:16:3e:b9:05:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:52Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 2, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'subnets': [{'id': 'c13625a3-6727-4af5-969f-5fccba782446', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:18:54.109898 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:54.110276 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.113622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41866) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.119157 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1740790247', 'description': 'tempest-secgroup-smoke-1740790247 description', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.150865 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.227837 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.231634 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.264942 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.266280 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1514671 Nov 24 16:18:54.266997 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd8f402-88cd-4001-b588-4bc7d7cd6c97 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroup': ['ID=29924edd-f685-4f6c-9337-1574bd96245f,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.269650 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41868) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.276570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.321694 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.364343 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.400132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.405458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.425233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d73bf216-0191-4a96-aeb5-a3edf2ac39e7,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.436900 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.438202 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-535f5ed0-12a4-448e-ba4e-93b09a2487e3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1676421 Nov 24 16:18:54.441295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41870) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.446400 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.474871 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.505633 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.535759 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.539492 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.557121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ffa629c-16d8-4d01-9364-ab3e31a72230,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.565571 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.566818 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-780ebeb1-8222-4b3a-b5e4-a41491d59504 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1246643 Nov 24 16:18:54.570513 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41872) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.574949 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.614782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.676541 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.680641 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.701054 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e881fa2-ea38-4f74-a7e9-5fa771033576,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.713765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.717476 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b119b4af-9b5b-4c95-8057-657ae066c757 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1435111 Nov 24 16:18:54.717872 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41874) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.722272 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.747706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.807454 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.811533 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.828639 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ccff2a62-cc36-4cda-aa89-e1d54b4f89e3,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.837108 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.838297 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-44100950-f398-4f82-9954-388a0fc4fac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1194484 Nov 24 16:18:54.840919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 41876) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.845425 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:54.866707 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.securitygroups_db [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Project 0e05ec47caaa4b86ba407fd376f503c6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:18:54.871580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.940769 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.945648 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.962812 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=786449f3-4b69-4282-8624-40d87d578996,revision_number=0']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:54.970503 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:54.971697 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-e1f9eeb2-4512-44e4-894d-c54807f17272 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1297805 Nov 24 16:18:54.974590 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 41878) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:54.980228 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'security_group_rule': {'security_group_id': '29924edd-f685-4f6c-9337-1574bd96245f', 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:18:55.011964 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.securitygroups_db [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Project 0e05ec47caaa4b86ba407fd376f503c6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:18:55.017649 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.085763 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.090554 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33211275'] for security_group_rule, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.110534 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5b2a1099-5837-41ce-a502-f4bb8c1ff542,revision_number=0']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:55.119516 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.120711 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-fdad69b8-dd9c-420d-8cae-b394452bcd59 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1451259 Nov 24 16:18:55.541299 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 82980381-12d7-40f4-85fb-9f92c3734df5 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:55.608698 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 82980381-12d7-40f4-85fb-9f92c3734df5 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:55.609357 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.697145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.717849 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] For port 82980381-12d7-40f4-85fb-9f92c3734df5, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=82980381-12d7-40f4-85fb-9f92c3734df5,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:55.722158 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:55.775175 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Pushing event updated for resources: {'Port': ['ID=82980381-12d7-40f4-85fb-9f92c3734df5,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:56.346337 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Sync routers for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:18:56.357786 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:56.358422 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:56.548951 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:56.757687 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '26fb9dba-1538-4672-8935-c93d6cecaaf0', 'name': '', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'mac_address': 'fa:16:3e:b9:05:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:52Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 2, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'subnets': [{'id': 'c13625a3-6727-4af5-969f-5fccba782446', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:56.784287 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Checking router: 4c19c2ef-4762-4c81-812a-5573ff4097d3 for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:18:56.784642 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Updating router 4c19c2ef-4762-4c81-812a-5573ff4097d3 port 26fb9dba-1538-4672-8935-c93d6cecaaf0 binding host dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:18:56.809815 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.077751 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks [] for port, precommit_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.082990 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.137450 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fd76c4-0447-4bcf-adce-6c63f09b423b None None] Pushing event updated for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=3']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:57.184229 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Attempting to bind port 26fb9dba-1538-4672-8935-c93d6cecaaf0 on host dv-cinder-818994-2-iscsi for vnic_type normal with profile {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:18:57.184598 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Attempting to bind port 26fb9dba-1538-4672-8935-c93d6cecaaf0 by drivers openvswitch,hyperv on host dv-cinder-818994-2-iscsi at level 0 using segments [{'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:18:57.184964 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Attempting to bind port 26fb9dba-1538-4672-8935-c93d6cecaaf0 on network 71de30af-668e-4bd8-a00b-993a1a013f86 {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:18:57.191033 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Checking agent: {'id': '4bd60d57-0589-4601-97fa-1ad6e6e2ea89', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818994-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 15, 57, 24), 'started_at': datetime.datetime(2021, 11, 24, 15, 57, 54), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 18, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818994-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:18:57.191401 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Checking segment: {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102790) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:18:57.191811 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.192212 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Bound using segment: {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'} {{(pid=102790) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:18:57.192695 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.managers [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Bound port: 26fb9dba-1538-4672-8935-c93d6cecaaf0, host: dv-cinder-818994-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '654244e8-cc72-4b31-be6c-c131be2ed667', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1042, 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86'}}] {{(pid=102790) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:18:57.193123 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.263181 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] For port 26fb9dba-1538-4672-8935-c93d6cecaaf0, host dv-cinder-818994-2-iscsi, cleared binding levels {{(pid=102790) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:18:57.266376 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.plugins.ml2.db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] For port 26fb9dba-1538-4672-8935-c93d6cecaaf0, host dv-cinder-818994-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=26fb9dba-1538-4672-8935-c93d6cecaaf0,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102790) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:18:57.270970 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron_lib.callbacks.manager [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102790) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.312069 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:57.312579 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.331335 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:18:57.331858 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:18:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:57.333784 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fd76c4-0447-4bcf-adce-6c63f09b423b None None] Pushing event updated for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=4']} {{(pid=102790) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:57.415448 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.450525 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] For port 26fb9dba-1538-4672-8935-c93d6cecaaf0, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=26fb9dba-1538-4672-8935-c93d6cecaaf0,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:18:57.450787 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:18:57.462742 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.517936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a663c59c-4693-42b0-8db8-8221826e70c0 None None] Pushing event updated for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:57.576213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 26fb9dba-1538-4672-8935-c93d6cecaaf0 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:57.621867 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-2dfdea20-f9f4-4fe1-b752-5703e336e0bc None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:57.622137 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2dfdea20-f9f4-4fe1-b752-5703e336e0bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.672052 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:57.672460 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:57.692569 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '26fb9dba-1538-4672-8935-c93d6cecaaf0', 'name': '', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'mac_address': 'fa:16:3e:b9:05:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:52Z', 'updated_at': '2021-11-24T16:18:57Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'subnets': [{'id': 'c13625a3-6727-4af5-969f-5fccba782446', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:18:57.721105 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10787440-11e1-4086-9e0f-b16a1ab75f2f None None] The sync data for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi is: [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '26fb9dba-1538-4672-8935-c93d6cecaaf0', 'name': '', 'network_id': '71de30af-668e-4bd8-a00b-993a1a013f86', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'mac_address': 'fa:16:3e:b9:05:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c13625a3-6727-4af5-969f-5fccba782446', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:52Z', 'updated_at': '2021-11-24T16:18:57Z', 'revision_number': 4, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'subnets': [{'id': 'c13625a3-6727-4af5-969f-5fccba782446', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:18:57.794974 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 82980381-12d7-40f4-85fb-9f92c3734df5 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:57.846868 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 82980381-12d7-40f4-85fb-9f92c3734df5 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:57.847239 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:59.508397 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 26fb9dba-1538-4672-8935-c93d6cecaaf0 up at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:18:59.561611 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Provisioning complete for port 26fb9dba-1538-4672-8935-c93d6cecaaf0 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:18:59.561981 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:14.330823 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:16.679224 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-84fe2e2a-f424-479a-a5e6-2452c3ae7d55 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1740790247&fields=id&tenant_id=0e05ec47caaa4b86ba407fd376f503c6 HTTP/1.1" status: 200 len: 267 time: 0.0439565 Nov 24 16:19:16.784645 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-0952c0c9-727c-4bfa-a698-26d812586905 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:16.786038 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-0952c0c9-727c-4bfa-a698-26d812586905 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 808 time: 0.1001501 Nov 24 16:19:16.800844 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-7473033a-4fb6-460d-944a-68661eac473e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/quotas/0e05ec47caaa4b86ba407fd376f503c6 HTTP/1.1" status: 200 len: 375 time: 0.0089140 Nov 24 16:19:16.854498 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-66a35112-1f39-4ef0-bc22-d9efc9bcebd8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0483305 Nov 24 16:19:16.950060 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-0c93a150-0252-48ae-8786-afdc058e92f6 service neutron] 10.222.0.72 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835962 Nov 24 16:19:17.040354 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-a9a99a03-0eca-4a3c-a096-a74c68a6f484 service neutron] 10.222.0.72 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841980 Nov 24 16:19:17.322049 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6c3d89b9-0797-4a8d-a192-d3981c82e396 req-fd3383ca-e8a5-4ea6-98e5-79c13c466096 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 210 time: 0.0272589 Nov 24 16:19:18.274857 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-e38afc09-9e6c-48a3-af2b-a0af8afad638 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:18.276329 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-e38afc09-9e6c-48a3-af2b-a0af8afad638 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 808 time: 0.1054876 Nov 24 16:19:18.341369 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-f0e5b426-d914-4f2e-8708-48c4cbf9a96b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0e05ec47caaa4b86ba407fd376f503c6 HTTP/1.1" status: 200 len: 380 time: 0.0544996 Nov 24 16:19:18.352393 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'port': {'device_id': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'admin_state_up': True, 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'security_groups': ['29924edd-f685-4f6c-9337-1574bd96245f']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:19:18.416864 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-58c2296b-b484-4331-9af2-6c95988a26e7 req-3567841f-c0d0-44d5-b142-d69edb34eefd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 210 time: 0.0268862 Nov 24 16:19:18.461924 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Made reservation on behalf of 0e05ec47caaa4b86ba407fd376f503c6 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:19:18.465580 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:18.592322 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Allocated IP 172.20.0.12 (7adfa203-bbb1-4530-a8be-f1ebfa6654ca/9fe1060b-8118-4779-9a4d-1c167ac19e40/3762c609-4d3f-4e0f-a146-c0077e3c9f5c) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:19:18.638124 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0dc44fbb-f292-469b-bcd2-31a71548fc30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:18.747382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:18.783190 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:18.828559 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:19:18.834416 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:19:18.836296 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:18.838420 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:19:18.887483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:18.888115 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:18.904918 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-54b82593-da89-42c4-a0ed-f6972ba2382b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5582328 Nov 24 16:19:18.917933 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Request body: {'port': {'device_id': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:19:18.977383 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.105188 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-bdafb62b-88c4-40ce-8642-3fe2846ff8ad None None] Provisioning complete for port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:19:19.105634 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bdafb62b-88c4-40ce-8642-3fe2846ff8ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.140469 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-bdafb62b-88c4-40ce-8642-3fe2846ff8ad None None] Port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:19:19.239644 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3762c609-4d3f-4e0f-a146-c0077e3c9f5c {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:19:19.246996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.258890 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Transition to ACTIVE for port object 3762c609-4d3f-4e0f-a146-c0077e3c9f5c will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:19:19.262752 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.329568 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:19.383729 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Attempting to bind port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:19:19.384449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Attempting to bind port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:19:19.384449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Attempting to bind port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c on network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:19:19.388831 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c on network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:19:19.389189 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Attempting to bind port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c on network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:19:19.394082 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 19, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:19:19.394419 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Checking segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:19:19.394804 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Bound using segment: {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:19:19.395230 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Bound port: 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '456a71c0-a4d3-41a5-a40f-101b1f134ec0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1048, 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:19:19.395666 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.461579 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:19:19.464781 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:19:19.469778 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.535612 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:19.536305 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.537756 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] 10.222.0.71 "PUT /v2.0/ports/3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1094 time: 0.6241202 Nov 24 16:19:19.540023 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:19:19.542405 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e2def4f-ceac-4eae-9129-8f07130be7ab" -d '{"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:19:19.567287 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21411cda-93e6-442a-8d41-ab87fc57f37e service neutron] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:19.587916 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c req-7e858db4-c002-4f2d-bc51-cabdebd5a0f9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:19.589750 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c req-7e858db4-c002-4f2d-bc51-cabdebd5a0f9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0954852 Nov 24 16:19:19.615000 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:19:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0be65d4f-8f8b-46ff-aba4-c365654199ca x-openstack-request-id: req-0be65d4f-8f8b-46ff-aba4-c365654199ca {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:19:19.616161 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:19:19.616430 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-0be65d4f-8f8b-46ff-aba4-c365654199ca {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:19:19.616844 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'status': 'completed', 'code': 200} Nov 24 16:19:19.675603 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c req-d4f0d17b-78f5-4238-9d65-f35da401a719 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0792179 Nov 24 16:19:19.682570 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-de66b0c5-5cdb-40e5-9a1c-bba8b100f955 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:19.684219 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-de66b0c5-5cdb-40e5-9a1c-bba8b100f955 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1097 time: 0.0807197 Nov 24 16:19:19.731209 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-87c75829-d0f2-4e28-a55f-3ce5d85d8d96 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 217 time: 0.0390708 Nov 24 16:19:19.779262 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-7d46bd47-6332-4660-9ed5-9f3d64e074df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:19.780819 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-7d46bd47-6332-4660-9ed5-9f3d64e074df service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0434878 Nov 24 16:19:19.826950 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-314a5c24-2649-44af-8843-884fcb50ad8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:19.828350 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-314a5c24-2649-44af-8843-884fcb50ad8e service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398464 Nov 24 16:19:19.919469 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-df8df5c1-2778-49f8-9e2a-0cbbd5e85921 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833600 Nov 24 16:19:20.007450 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 req-9e6b9efa-4d32-4e39-9ab6-a01c5fa337e5 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813746 Nov 24 16:19:20.100156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-cbb54163-8ae3-4157-8aa2-4bd19aaa1430 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:20.102106 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-cbb54163-8ae3-4157-8aa2-4bd19aaa1430 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1097 time: 0.0462861 Nov 24 16:19:20.196298 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-2a9f6d49-3b35-45b8-ad1c-50dec9c167f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:20.197808 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-2a9f6d49-3b35-45b8-ad1c-50dec9c167f4 service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0870471 Nov 24 16:19:20.242939 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0de709fd-ef4a-45e3-95f7-34480d779e4d service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 217 time: 0.0378911 Nov 24 16:19:20.292076 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-d2cefb81-1d1a-47da-b1f8-5d1609a62c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:20.293545 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-d2cefb81-1d1a-47da-b1f8-5d1609a62c45 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0432208 Nov 24 16:19:20.341704 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-9af27d14-d41b-4b17-86aa-877dbf5ed0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:20.343215 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-9af27d14-d41b-4b17-86aa-877dbf5ed0a4 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432537 Nov 24 16:19:20.440612 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-18bb7881-0853-4797-9990-1b834fa4703d service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902014 Nov 24 16:19:20.531042 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-07007067-49e0-4291-aafd-3f7b715b0eb8 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830641 Nov 24 16:19:20.793836 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f609c20-4797-4ea1-ae32-8c12547fdd35 req-06eb6aed-ac83-4c3e-8351-6efc763af257 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:20.795308 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7f609c20-4797-4ea1-ae32-8c12547fdd35 req-06eb6aed-ac83-4c3e-8351-6efc763af257 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0487051 Nov 24 16:19:20.843518 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-7f609c20-4797-4ea1-ae32-8c12547fdd35 req-20fe6210-8920-4018-9123-1df8c733756c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422592 Nov 24 16:19:21.288281 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b7c5666c-98aa-4f36-8219-651d7b765f65 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:21.957300 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc2da74-4508-47e3-a69b-2f898883b247 req-22702adb-c7ce-4d0d-90d3-80eb5d8e506f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:21.958755 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0cc2da74-4508-47e3-a69b-2f898883b247 req-22702adb-c7ce-4d0d-90d3-80eb5d8e506f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0471947 Nov 24 16:19:22.011393 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0cc2da74-4508-47e3-a69b-2f898883b247 req-ca7fa8eb-43bf-4062-a4f1-250097f3d7d0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461090 Nov 24 16:19:22.683587 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:23.133814 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2158631-fedd-4e5c-95a9-8b16266178d7 req-f5ba952e-3c39-4c94-bd44-ab3fdd3f753c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:23.135317 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d2158631-fedd-4e5c-95a9-8b16266178d7 req-f5ba952e-3c39-4c94-bd44-ab3fdd3f753c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0536351 Nov 24 16:19:23.184426 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d2158631-fedd-4e5c-95a9-8b16266178d7 req-62d80626-011b-4cc6-aa4b-5024171b2e2b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431437 Nov 24 16:19:24.298214 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a386493-2d1e-4c34-94d0-877ef1ed73dc req-9574fe77-8fc9-4af0-8dec-76db6e4c9ec2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:24.300276 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6a386493-2d1e-4c34-94d0-877ef1ed73dc req-9574fe77-8fc9-4af0-8dec-76db6e4c9ec2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0491982 Nov 24 16:19:24.349839 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6a386493-2d1e-4c34-94d0-877ef1ed73dc req-043efac2-9f84-473b-bab8-dcd065e8c380 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432739 Nov 24 16:19:24.365384 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:24.505463 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:25.463803 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c3e740-df6e-4850-8b29-193316d51740 req-a2fb0ebb-4fe4-43fb-9f56-267db69871dd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:25.465325 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c4c3e740-df6e-4850-8b29-193316d51740 req-a2fb0ebb-4fe4-43fb-9f56-267db69871dd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0480413 Nov 24 16:19:25.514004 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-c4c3e740-df6e-4850-8b29-193316d51740 req-159e498e-a111-431b-a6c3-1d3aec9a6088 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426521 Nov 24 16:19:26.627870 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e14560b-8a07-49c9-ac58-cc2c9421104f req-6cf80d6b-1817-4a14-8daa-36a9efb9e2c1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:26.629364 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7e14560b-8a07-49c9-ac58-cc2c9421104f req-6cf80d6b-1817-4a14-8daa-36a9efb9e2c1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0504012 Nov 24 16:19:26.682903 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-7e14560b-8a07-49c9-ac58-cc2c9421104f req-7a558a59-963f-4398-bcb3-8df30bdaa67b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471766 Nov 24 16:19:27.116896 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:19:27.230628 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:19:27.241538 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'mac_address': 'fa:16:3e:06:c3:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1048, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:19:27.279013 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:27.291202 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3762c609-4d3f-4e0f-a146-c0077e3c9f5c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:19:27.310115 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:19:27.314191 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:27.366998 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:27.644070 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['3762c609-4d3f-4e0f-a146-c0077e3c9f5c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:19:27.799280 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88fdc612-e65a-4267-b4fb-b7523226df40 req-2b92223a-51ea-4852-aaae-918912f379a8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:27.800792 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88fdc612-e65a-4267-b4fb-b7523226df40 req-2b92223a-51ea-4852-aaae-918912f379a8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 945 time: 0.0483968 Nov 24 16:19:27.855410 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88fdc612-e65a-4267-b4fb-b7523226df40 req-69b9ca86-213c-401c-ada2-b5cd181f577e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473542 Nov 24 16:19:27.905495 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-b4cadc8a-edae-43af-bfb8-acd0bfc3342d service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0529106 Nov 24 16:19:27.989349 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-b2870185-21d2-4b80-bf2c-08a99af7e02f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:27.990925 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-b2870185-21d2-4b80-bf2c-08a99af7e02f service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 1098 time: 0.0419672 Nov 24 16:19:28.099205 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-ed265953-e735-4b12-95bb-eda5ba3df8c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:28.100644 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-ed265953-e735-4b12-95bb-eda5ba3df8c4 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0853531 Nov 24 16:19:28.167596 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-68c8ddcb-4308-4e55-a93b-b77ed54a0f1c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 200 len: 1001 time: 0.0596597 Nov 24 16:19:28.216661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-c00eef73-0488-4dbe-bb0b-be97708bf190 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:28.218151 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-c00eef73-0488-4dbe-bb0b-be97708bf190 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0433574 Nov 24 16:19:28.267412 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-724c68f3-a2f2-4932-8560-bee772069239 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:28.268889 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-724c68f3-a2f2-4932-8560-bee772069239 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434375 Nov 24 16:19:28.354869 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-d02a7713-c883-4b03-82d9-c544c2c7c4c4 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786562 Nov 24 16:19:28.446154 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ed49ff48-1f06-4edf-ac50-c556e8d62536 req-9f3d2654-c8e1-4960-b546-eee3ece69b97 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833273 Nov 24 16:19:28.970294 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380754b5-c5cc-435c-a6a2-d0599e8b178d req-86c280fa-1805-4702-8483-cc178089fefc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:28.971862 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-380754b5-c5cc-435c-a6a2-d0599e8b178d req-86c280fa-1805-4702-8483-cc178089fefc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 945 time: 0.0487561 Nov 24 16:19:28.999718 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:19:29.020967 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-380754b5-c5cc-435c-a6a2-d0599e8b178d req-c05a5487-cf28-4c21-a730-5dafc40cbf71 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432084 Nov 24 16:19:29.124341 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:19:29.172892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:19:29.176891 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:19:29.177289 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:29.255146 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:29.280611 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:19:29.282836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c705598-a1f1-4e3e-b630-e1915ecbb48c" -d '{"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:19:29.295882 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:19:29.300410 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:29.325221 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:19:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 x-openstack-request-id: req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:19:29.325513 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:19:29.325763 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:19:29.326145 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'code': 200} Nov 24 16:19:29.352929 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:29.535089 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4346fa3c-b858-43b1-9621-5c9121a8a4a6 req-8ea5e0bb-7458-43e1-8f4a-04163ff1cfc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:29.536565 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4346fa3c-b858-43b1-9621-5c9121a8a4a6 req-8ea5e0bb-7458-43e1-8f4a-04163ff1cfc3 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0406382 Nov 24 16:19:29.588648 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-4346fa3c-b858-43b1-9621-5c9121a8a4a6 req-9b17dbc9-c980-4f0f-bffb-5bb3c3de6f44 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445774 Nov 24 16:19:30.135795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de05d3e9-341e-4605-8d01-315fb972ea96 req-38fbe04c-a6ad-4c1b-9b63-d5c24cf6c7d9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:30.137273 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-de05d3e9-341e-4605-8d01-315fb972ea96 req-38fbe04c-a6ad-4c1b-9b63-d5c24cf6c7d9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0485282 Nov 24 16:19:30.185595 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-de05d3e9-341e-4605-8d01-315fb972ea96 req-63ef2a4b-a63d-4b7f-9ed1-ef6e88a04ef9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424461 Nov 24 16:19:31.304049 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b req-7c12d0bc-edaf-4c5c-8cab-b55c4fe86ef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:31.305659 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b req-7c12d0bc-edaf-4c5c-8cab-b55c4fe86ef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0488601 Nov 24 16:19:31.355624 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b req-fc076e6b-bda1-498e-a54e-76d7d79931db tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440650 Nov 24 16:19:31.469223 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1f1cdb-61f4-4e72-84b7-429907011963 req-db01281e-cde2-42b7-8593-7c9e5260b0df tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:31.470633 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1f1cdb-61f4-4e72-84b7-429907011963 req-db01281e-cde2-42b7-8593-7c9e5260b0df tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0482445 Nov 24 16:19:31.519301 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8a1f1cdb-61f4-4e72-84b7-429907011963 req-99c819f0-7b0e-45ed-9984-3d1045332a8d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419748 Nov 24 16:19:31.541438 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42042) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:19:31.671101 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e9203d2-1c23-4b48-a195-69f4814da989 tempest-TestShelveInstance-361324664 tempest-TestShelveInstance-361324664-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:31.672582 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-3e9203d2-1c23-4b48-a195-69f4814da989 tempest-TestShelveInstance-361324664 tempest-TestShelveInstance-361324664-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1094 time: 0.1301804 Nov 24 16:19:31.675475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42046) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:19:31.680360 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:19:31.701511 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:31.794609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:31.896738 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Allocated IP 172.27.0.124 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/b8948ad1-d27a-4a2a-a14f-3a9ea8edee28) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:19:31.993923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.026747 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.063344 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:19:32.066086 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:19:32.071546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:19:32.098148 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'Port': ['ID=b8948ad1-d27a-4a2a-a14f-3a9ea8edee28,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:32.419455 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.485386 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.632638 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.637483 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.701674 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event updated for resources: {'Port': ['ID=b8948ad1-d27a-4a2a-a14f-3a9ea8edee28,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:32.714938 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:32.813040 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Floating IP 604022b0-48e7-4f1f-8e7d-48124f4e5f59 associated. External IP: 172.27.0.124, port: 3762c609-4d3f-4e0f-a146-c0077e3c9f5c. Nov 24 16:19:33.270984 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Router 1f3aee64-2d5d-4b44-a102-e57424d0c018 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:19:33.388229 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:19:33.399132 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Sync routers for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:19:33.406458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:33.408965 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:19:33.409627 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:33.447124 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-b24ea2fd-1dd3-4e69-80fc-a7a5367fa915 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7611179 Nov 24 16:19:33.447124 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:19:33.447124 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d4047ec-159b-4aa6-8d76-b16dddb0d388" -d '{"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:19:33.478743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:19:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a3399ae-c93b-43d6-a577-09f0df084be0 x-openstack-request-id: req-0a3399ae-c93b-43d6-a577-09f0df084be0 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:19:33.479043 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:19:33.479312 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-0a3399ae-c93b-43d6-a577-09f0df084be0 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:19:33.479700 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'status': 'completed', 'code': 200} Nov 24 16:19:33.522686 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:19:33.541775 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-5ef22e7d-ef2d-4b0a-803f-786386e78a01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:33.543269 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-5ef22e7d-ef2d-4b0a-803f-786386e78a01 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0409243 Nov 24 16:19:33.642333 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-6f177fac-7b6e-472b-802a-aeaf7bfad1b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:33.643793 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-6f177fac-7b6e-472b-802a-aeaf7bfad1b9 service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0940850 Nov 24 16:19:33.711960 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-165ff142-929c-4227-a3b9-64c4d3d58deb service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1000 time: 0.0613396 Nov 24 16:19:33.759032 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '604022b0-48e7-4f1f-8e7d-48124f4e5f59', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'floating_ip_address': '172.27.0.124', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'mac_address': 'fa:16:3e:06:c3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:19:32Z', 'updated_at': '2021-11-24T16:19:32Z', 'revision_number': 0, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:33.767361 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-d0ca9770-cb11-47e4-aaca-b4aec03ac8ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:33.768837 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-d0ca9770-cb11-47e4-aaca-b4aec03ac8ce service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0491657 Nov 24 16:19:33.784787 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Checking router: 1f3aee64-2d5d-4b44-a102-e57424d0c018 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:19:33.793788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:19:33.794395 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:33.816011 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-bddceb4d-3bae-44a3-82ed-e1d21140bfed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:33.817554 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-bddceb4d-3bae-44a3-82ed-e1d21140bfed service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0417149 Nov 24 16:19:33.898820 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:19:33.910196 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-04243776-a8bd-4fdd-b954-13b54095c173 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849898 Nov 24 16:19:34.007790 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-929c2927-527f-4ab4-8fd2-f31a6bc2eb5e service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893285 Nov 24 16:19:34.128634 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '604022b0-48e7-4f1f-8e7d-48124f4e5f59', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'floating_ip_address': '172.27.0.124', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'mac_address': 'fa:16:3e:06:c3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:19:32Z', 'updated_at': '2021-11-24T16:19:32Z', 'revision_number': 0, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:34.154779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aae55d85-ad17-40ba-ad09-4b64baf1b25c None None] The sync data for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi is: [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '604022b0-48e7-4f1f-8e7d-48124f4e5f59', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'floating_ip_address': '172.27.0.124', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'mac_address': 'fa:16:3e:06:c3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:19:32Z', 'updated_at': '2021-11-24T16:19:32Z', 'revision_number': 0, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:19:34.343976 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8831fd0e-6195-4be0-a273-fd52b2a28fb1 None None] New status for floating IP 604022b0-48e7-4f1f-8e7d-48124f4e5f59: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:19:44.359002 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:47.691813 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e267f7-8145-4212-bf93-d7eb2917480e req-0c99a4e2-27e4-4f7d-bede-7ff0118f8253 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:47.693308 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-90e267f7-8145-4212-bf93-d7eb2917480e req-0c99a4e2-27e4-4f7d-bede-7ff0118f8253 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0493910 Nov 24 16:19:47.742123 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-90e267f7-8145-4212-bf93-d7eb2917480e req-3f567c46-3fc3-4eae-acab-499b7a6d163c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427327 Nov 24 16:19:48.629592 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bb37fea1-a9b5-46b5-859a-4e476f4a009a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:48.862158 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ca6243-31e3-4049-ac13-f2256178e1c6 req-9028ec2e-cbd8-4f33-928a-b6a310064fa9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:48.863638 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-62ca6243-31e3-4049-ac13-f2256178e1c6 req-9028ec2e-cbd8-4f33-928a-b6a310064fa9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0527687 Nov 24 16:19:48.912663 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-62ca6243-31e3-4049-ac13-f2256178e1c6 req-23823f6f-6ce2-4cc1-b260-b776e1ed4c85 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419476 Nov 24 16:19:49.342505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-08fdec6e-4ef8-4aaa-9753-15f3db29817e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:49.343924 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-08fdec6e-4ef8-4aaa-9753-15f3db29817e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 945 time: 0.0514679 Nov 24 16:19:49.432461 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port d9123976-7ebf-4103-a11c-67a75901f6c9 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:19:49.432792 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.528736 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] For port d9123976-7ebf-4103-a11c-67a75901f6c9, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=d9123976-7ebf-4103-a11c-67a75901f6c9,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:19:49.529119 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.718474 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.718874 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.719115 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 824de0e5-547d-422f-ba1f-5a10d2a418b6 disassociated. External IP: 172.27.0.147, port: d9123976-7ebf-4103-a11c-67a75901f6c9. Nov 24 16:19:49.719447 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for d9123976-7ebf-4103-a11c-67a75901f6c9 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:19:49.846789 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.876647 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=d9123976-7ebf-4103-a11c-67a75901f6c9,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:49.888299 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.888654 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.888993 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.889360 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.889691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.890022 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.890351 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.890682 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.891011 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.891335 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.891657 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:49.891977 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:50.002031 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:19:50.025099 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 req-f3610728-a264-4f17-a36b-fcabd06c0985 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=2843917b-11a2-42d7-bf56-f60e26980b1f HTTP/1.1" status: 200 len: 210 time: 0.0303771 Nov 24 16:19:50.110899 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:19:50.122463 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:19:50.134025 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:19:50.134648 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:50.151188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] No DVR routers for this DVR port d9123976-7ebf-4103-a11c-67a75901f6c9 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:19:50.153658 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:50.156944 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fff91bfc-63c8-449c-aa89-c98bb94ca257 req-86f3dbf3-8d3d-48ba-a43c-55f437e6d695 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "DELETE /v2.0/ports/d9123976-7ebf-4103-a11c-67a75901f6c9 HTTP/1.1" status: 204 len: 173 time: 0.8058026 Nov 24 16:19:50.157407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'name': 'network-vif-deleted', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:19:50.159635 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0e57a0e-6359-4d31-be7a-527c33402087" -d '{"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-deleted", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:19:50.198887 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:19:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a18c224a-26ac-4621-89d1-75b68c674fc8 x-openstack-request-id: req-a18c224a-26ac-4621-89d1-75b68c674fc8 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:19:50.199191 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-deleted", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:19:50.199534 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-a18c224a-26ac-4621-89d1-75b68c674fc8 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:19:50.199899 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2843917b-11a2-42d7-bf56-f60e26980b1f', 'name': 'network-vif-deleted', 'tag': 'd9123976-7ebf-4103-a11c-67a75901f6c9', 'status': 'completed', 'code': 200} Nov 24 16:19:50.252568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:19:50.464249 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:50.494164 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:19:50.502702 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:19:50.503252 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:50.609756 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:19:50.820086 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:19:50.845730 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d3cf06-c084-4af1-a3d7-660e659a8955 None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:19:51.071177 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095f1d55-9eb2-4217-9f2e-5dc8f9bcf838 None None] New status for floating IP 824de0e5-547d-422f-ba1f-5a10d2a418b6: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:19:51.286465 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-07e270e9-3a3c-49ab-b53a-c94cb533d92b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-504417305&fields=id&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 267 time: 0.0449479 Nov 24 16:19:51.290152 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0d272e8e-daa5-4e80-b9e1-0883891660d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:51.400127 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-d40c5599-f59c-4cfb-8d3b-3f695c43e5b7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:51.401516 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-d40c5599-f59c-4cfb-8d3b-3f695c43e5b7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1077936 Nov 24 16:19:51.416400 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-a2e6d00c-c264-4269-b3cc-1b21ddaef88d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/quotas/7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 375 time: 0.0092094 Nov 24 16:19:51.468027 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-4c3e6a97-0dd7-4ada-a2ab-767e8fa36fc6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0463507 Nov 24 16:19:51.527385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-7f581832-69c6-48a4-946b-9187ba116bbe service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102788) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:19:51.528407 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-7f581832-69c6-48a4-946b-9187ba116bbe service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0479567 Nov 24 16:19:51.620987 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-acdfe9a5-842d-4426-b064-c209fc7366b1 service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862529 Nov 24 16:19:51.712042 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-bf8c02ef-a1b4-4750-a136-064572b5f394 service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847561 Nov 24 16:19:51.994399 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fdca1ba9-eabc-4331-825b-fd6da09e11a2 req-6fa10150-d126-48d0-ac82-58ffb3dff4b5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 210 time: 0.0254772 Nov 24 16:19:52.686785 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:52.899259 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-842d1c08-ba5c-4e33-8a42-1444cfe2c980 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:52.900707 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-842d1c08-ba5c-4e33-8a42-1444cfe2c980 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1084821 Nov 24 16:19:52.966995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-d0bb060c-2d15-4031-bba5-2dea36b81b7d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 379 time: 0.0554700 Nov 24 16:19:52.976941 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'port': {'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'admin_state_up': True, 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'security_groups': ['2d157481-120f-42c9-be9e-2b8cef9b61c9']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:19:53.089702 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Made reservation on behalf of 7ae2d50102bf491986834edf07a6a868 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:19:53.093569 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.258174 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f50314fc-b3fe-4f34-8ce1-376a962f0493 req-da7f0b82-6d9d-4890-883b-fa944df91ae4 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 210 time: 0.0357082 Nov 24 16:19:53.262010 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.20.0.10 (e94d2a4c-106b-44d2-b8a7-a2440253d60c/d3f57000-e20c-491a-8f21-32857a544343/f28496a8-b616-467e-a96a-64cd302d5c4e) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:19:53.282145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device d9123976-7ebf-4103-a11c-67a75901f6c9 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:19:53.307309 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: d9123976-7ebf-4103-a11c-67a75901f6c9 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:19:53.307933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device d9123976-7ebf-4103-a11c-67a75901f6c9 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:19:53.410985 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.444028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.487215 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:19:53.490114 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:19:53.494941 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:19:53.501641 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:53.549102 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:53.549726 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.567571 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-87d510d4-bfe5-483c-ae2a-b1dffd043964 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5944197 Nov 24 16:19:53.579873 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Request body: {'port': {'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:19:53.639528 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.728003 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-5fbef509-03c9-414f-bfbb-2a3b7bfc5a0a None None] Provisioning complete for port f28496a8-b616-467e-a96a-64cd302d5c4e triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:19:53.728586 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-5fbef509-03c9-414f-bfbb-2a3b7bfc5a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.762121 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-5fbef509-03c9-414f-bfbb-2a3b7bfc5a0a None None] Port f28496a8-b616-467e-a96a-64cd302d5c4e cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:19:53.895330 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f28496a8-b616-467e-a96a-64cd302d5c4e {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:19:53.903660 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.917308 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Transition to ACTIVE for port object f28496a8-b616-467e-a96a-64cd302d5c4e will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:19:53.920878 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:53.992694 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Pushing event updated for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:54.045664 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Attempting to bind port f28496a8-b616-467e-a96a-64cd302d5c4e on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:19:54.046145 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Attempting to bind port f28496a8-b616-467e-a96a-64cd302d5c4e by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:19:54.046481 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Attempting to bind port f28496a8-b616-467e-a96a-64cd302d5c4e on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:19:54.051235 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Port f28496a8-b616-467e-a96a-64cd302d5c4e on network e94d2a4c-106b-44d2-b8a7-a2440253d60c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:19:54.051555 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Attempting to bind port f28496a8-b616-467e-a96a-64cd302d5c4e on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:19:54.057180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 19, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:19:54.057523 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:19:54.057917 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Bound using segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:19:54.058354 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Bound port: f28496a8-b616-467e-a96a-64cd302d5c4e, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:19:54.058721 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:54.123996 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:19:54.127437 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f28496a8-b616-467e-a96a-64cd302d5c4e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:19:54.132907 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:54.169392 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.170028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:54.171403 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] 10.222.0.71 "PUT /v2.0/ports/f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 1094 time: 0.5958242 Nov 24 16:19:54.172426 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:19:54.178028 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e115d8c9-af83-49ce-9436-d6246372a7f1" -d '{"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:19:54.210366 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46471172-cd26-4086-85f7-2e854e323e9b service neutron] Pushing event updated for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:19:54.243780 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:19:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afeff31c-1e26-45af-9e3b-937cb84ccdab x-openstack-request-id: req-afeff31c-1e26-45af-9e3b-937cb84ccdab {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:19:54.244009 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:19:54.244242 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-afeff31c-1e26-45af-9e3b-937cb84ccdab {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:19:54.244650 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'status': 'completed', 'code': 200} Nov 24 16:19:54.261748 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-6e5adf9a-d42a-43a4-93e9-b0e7ed3bcf26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.263267 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-6e5adf9a-d42a-43a4-93e9-b0e7ed3bcf26 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1097 time: 0.0473497 Nov 24 16:19:54.307666 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-55c68bce-fef2-498f-ac98-842fa4e7aec1 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 217 time: 0.0361538 Nov 24 16:19:54.369906 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:54.403740 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-913046b6-7252-4a07-88a9-32a0363c6b08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.405263 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-913046b6-7252-4a07-88a9-32a0363c6b08 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0883808 Nov 24 16:19:54.413710 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f630bc1-edad-4d7c-aeab-071baa62dad2 req-b94dd6c5-2509-496a-975b-beed7d8b9a8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.415139 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1f630bc1-edad-4d7c-aeab-071baa62dad2 req-b94dd6c5-2509-496a-975b-beed7d8b9a8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0684102 Nov 24 16:19:54.480208 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-0eac2213-8afe-4bf5-a740-9c83201d94b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.481745 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-0eac2213-8afe-4bf5-a740-9c83201d94b6 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0657523 Nov 24 16:19:54.490587 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1f630bc1-edad-4d7c-aeab-071baa62dad2 req-f1c5880a-7b43-44bb-8bf8-3b84fb496822 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0671091 Nov 24 16:19:54.518379 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:54.577307 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-6b0571e6-316f-4b6a-a75a-cc8209d4b722 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852165 Nov 24 16:19:54.667995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 req-02e74ff6-88fc-4851-b62a-79bd8d8d3d28 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826066 Nov 24 16:19:54.761853 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-3a5602f0-487d-4ba2-adf4-d2dc138d13c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.763240 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-3a5602f0-487d-4ba2-adf4-d2dc138d13c6 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1097 time: 0.0453985 Nov 24 16:19:54.852385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-4f685ada-4f17-430a-83b1-72f62898787d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.853876 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-4f685ada-4f17-430a-83b1-72f62898787d service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0837417 Nov 24 16:19:54.899463 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-addc2f54-39a6-4ffd-a640-a972808d8876 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 217 time: 0.0370092 Nov 24 16:19:54.947595 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-28e46cb8-d103-4b58-a929-d48242c3cc1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.949017 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-28e46cb8-d103-4b58-a929-d48242c3cc1f service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0429981 Nov 24 16:19:54.995623 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-a2e19b72-c11d-49a7-9af2-c4018aec9728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:54.997138 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-a2e19b72-c11d-49a7-9af2-c4018aec9728 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405686 Nov 24 16:19:55.087561 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-b8898d20-7fbf-4825-9abc-e4a83d7293a4 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815618 Nov 24 16:19:55.177681 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-943a375b-fa2f-4e50-9f7c-1008aa992cfc service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829270 Nov 24 16:19:55.613577 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8069d24d-8ef4-4d2b-8949-81792b43787c req-58824d10-05e3-4c6c-a003-3821e21aa7f6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:55.615148 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8069d24d-8ef4-4d2b-8949-81792b43787c req-58824d10-05e3-4c6c-a003-3821e21aa7f6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0500958 Nov 24 16:19:55.665752 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8069d24d-8ef4-4d2b-8949-81792b43787c req-a664ec19-6564-4d15-b6d3-6aacabde8c00 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443602 Nov 24 16:19:56.778191 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe07b68-3cdf-4651-9922-9a950b14d519 req-291d3ec7-b6e4-4c30-8230-5b8ebadcdb9a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:56.779681 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-abe07b68-3cdf-4651-9922-9a950b14d519 req-291d3ec7-b6e4-4c30-8230-5b8ebadcdb9a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0479081 Nov 24 16:19:57.083168 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-abe07b68-3cdf-4651-9922-9a950b14d519 req-7d46eb25-283c-4f48-a10e-d2f975ab8be1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2974775 Nov 24 16:19:58.197983 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3045b577-7361-4fdd-8437-a3dc79bf964e req-52581470-535a-472f-b38d-f3909a62f9b1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:58.199462 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3045b577-7361-4fdd-8437-a3dc79bf964e req-52581470-535a-472f-b38d-f3909a62f9b1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0495555 Nov 24 16:19:58.253239 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-3045b577-7361-4fdd-8437-a3dc79bf964e req-626cab6b-1149-402a-adaf-a35086f97523 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477574 Nov 24 16:19:59.367141 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 req-468a58ad-2fb1-46d8-b4ba-57129b5ca184 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:19:59.368596 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 req-468a58ad-2fb1-46d8-b4ba-57129b5ca184 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0488188 Nov 24 16:19:59.416918 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 req-0b87c39b-59c0-45de-a4aa-a0a188e18cf0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418656 Nov 24 16:20:00.531392 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45466edf-44fa-4193-9e4d-486bbbdd9065 req-114a6b57-eaa5-4b72-b631-d241329b5ee6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:00.532776 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-45466edf-44fa-4193-9e4d-486bbbdd9065 req-114a6b57-eaa5-4b72-b631-d241329b5ee6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 944 time: 0.0493813 Nov 24 16:20:00.583142 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-45466edf-44fa-4193-9e4d-486bbbdd9065 req-3d3346c5-0c66-415c-bb10-eabd1b1d4d49 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441048 Nov 24 16:20:01.296892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f28496a8-b616-467e-a96a-64cd302d5c4e details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:20:01.394297 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f28496a8-b616-467e-a96a-64cd302d5c4e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:20:01.405771 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1010, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:20:01.442200 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:01.458197 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f28496a8-b616-467e-a96a-64cd302d5c4e {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:20:01.479215 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f28496a8-b616-467e-a96a-64cd302d5c4e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:20:01.483293 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:01.529553 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:20:01.536952 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.537337 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.538440 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.538796 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.539134 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.539476 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.539813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.540149 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.540482 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.540813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.541185 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.541515 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:01.697962 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 req-00a38d34-fde7-4d9d-936c-cc8a3bea5c10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:01.699537 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 req-00a38d34-fde7-4d9d-936c-cc8a3bea5c10 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 945 time: 0.0485680 Nov 24 16:20:01.748544 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 req-ed84b521-6f87-4561-ab2e-62f52a6e63cb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429249 Nov 24 16:20:01.790983 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['f28496a8-b616-467e-a96a-64cd302d5c4e'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:20:02.865088 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e req-3dbc77c5-b394-4b53-bc90-4655862a092b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:02.866547 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e req-3dbc77c5-b394-4b53-bc90-4655862a092b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 945 time: 0.0489960 Nov 24 16:20:02.914937 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e req-616969c1-dba5-41a9-a0d0-d9a68a255243 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425372 Nov 24 16:20:03.296140 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f28496a8-b616-467e-a96a-64cd302d5c4e up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:20:03.343329 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port f28496a8-b616-467e-a96a-64cd302d5c4e completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:20:03.346996 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port f28496a8-b616-467e-a96a-64cd302d5c4e triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:20:03.347370 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:03.426320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:03.447571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:20:03.449864 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-146bccbd-cb92-4c2d-adcb-61e9e602557a" -d '{"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-plugged", "status": "completed", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:20:03.463065 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f28496a8-b616-467e-a96a-64cd302d5c4e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:20:03.467040 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:03.503751 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:20:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 x-openstack-request-id: req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:20:03.504068 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-plugged", "status": "completed", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:20:03.504317 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:20:03.504703 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'code': 200} Nov 24 16:20:03.516685 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:20:03.718820 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5d7b1e-a768-4c55-8ada-732e9d801ab1 req-586a2fb7-59cc-486d-bbaf-f33d80a26b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:03.720207 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca5d7b1e-a768-4c55-8ada-732e9d801ab1 req-586a2fb7-59cc-486d-bbaf-f33d80a26b06 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0427976 Nov 24 16:20:03.767933 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ca5d7b1e-a768-4c55-8ada-732e9d801ab1 req-fd3eb944-ce1e-4501-aa04-baeca86a8b7d service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393867 Nov 24 16:20:04.034202 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 req-d59cb134-2cf5-446e-abbc-dd3d031f7816 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:04.035575 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 req-d59cb134-2cf5-446e-abbc-dd3d031f7816 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0534420 Nov 24 16:20:04.083995 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 req-58f6b485-e16a-4712-b2aa-3b4cd5eba5f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424683 Nov 24 16:20:05.207057 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 req-7d0160a7-c783-4ca8-8053-3e091382bcd6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:05.208548 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 req-7d0160a7-c783-4ca8-8053-3e091382bcd6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0488403 Nov 24 16:20:05.260217 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 req-6d87a2ba-ab4f-4d59-b62f-153160a9c5dc tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453632 Nov 24 16:20:05.379399 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 req-a2332b09-9e2c-4730-b015-d88519445786 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:05.380785 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 req-a2332b09-9e2c-4730-b015-d88519445786 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0496862 Nov 24 16:20:05.429477 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 req-bb6f3398-cbe6-4b9e-808c-175d6705192f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427334 Nov 24 16:20:05.453736 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42124) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:20:05.498848 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d28652d-0cdc-42d2-88a0-85af151c6153 tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:05.500625 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4d28652d-0cdc-42d2-88a0-85af151c6153 tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1094 time: 0.0459151 Nov 24 16:20:05.503393 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42126) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:20:05.507825 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.v2.base [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address': '172.20.0.10'}} {{(pid=102787) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:20:05.530123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:05.630179 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:05.752341 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_common [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.27.0.203 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/897ca4b0-b7c0-4253-9ef3-c2c796552112) {{(pid=102787) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:20:05.859741 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:05.892328 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:05.934882 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102787) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:20:05.939050 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.base_scheduler [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102787) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:20:05.943345 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102787) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:20:05.946330 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=897ca4b0-b7c0-4253-9ef3-c2c796552112,revision_number=1']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:20:05.970336 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.970693 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.971039 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.971378 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.971710 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.972044 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.972373 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.972703 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.973049 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.973388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.973712 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.974036 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:20:05.998853 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:20:06.305119 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:06.613464 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:06.761923 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:06.766470 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30799541'] for port, after_update {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:06.837537 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=897ca4b0-b7c0-4253-9ef3-c2c796552112,revision_number=2']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:20:06.847410 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:06.946241 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 0c779274-dadf-4aa6-89b9-4f51ac27e896 associated. External IP: 172.27.0.203, port: f28496a8-b616-467e-a96a-64cd302d5c4e. Nov 24 16:20:07.154205 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:20:07.264433 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:20:07.275040 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:20:07.282300 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:07.285339 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:20:07.285959 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:20:07.321051 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3a878a47-9af6-4306-9f33-b97236c87ddd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8052354 Nov 24 16:20:07.321051 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:20:07.321051 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae695356-95fa-4cbe-a460-f0c32d76770b" -d '{"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:20:07.395371 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:20:07.436447 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:20:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92f84eca-79dd-4d92-adb3-37427bcb038e x-openstack-request-id: req-92f84eca-79dd-4d92-adb3-37427bcb038e {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:20:07.436749 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:20:07.437008 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-92f84eca-79dd-4d92-adb3-37427bcb038e {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:20:07.437466 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'status': 'completed', 'code': 200} Nov 24 16:20:07.502929 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-f405eeb1-2a96-4844-8310-2857d7ead209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:07.504398 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-f405eeb1-2a96-4844-8310-2857d7ead209 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0430739 Nov 24 16:20:07.594209 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-c73c1118-ed62-4589-ae04-488476ccb15d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:07.595730 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-c73c1118-ed62-4589-ae04-488476ccb15d service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0829992 Nov 24 16:20:07.616639 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:06Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:20:07.652718 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:20:07.660995 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:20:07.661625 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:19:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:20:07.666520 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-42f269d3-97be-4e91-bd57-7cd60f95c046 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 1000 time: 0.0638549 Nov 24 16:20:07.716324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-e9162346-30f4-4091-b72a-194c59f0ccc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:07.717814 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-e9162346-30f4-4091-b72a-194c59f0ccc6 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0446925 Nov 24 16:20:07.762967 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:20:07.763399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-691d3380-cdaa-460b-889f-d64fa2e7dd8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:07.764894 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-691d3380-cdaa-460b-889f-d64fa2e7dd8d service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403805 Nov 24 16:20:07.859780 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-6f561ad2-39ff-44ff-9dda-6b917ff4dc63 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860517 Nov 24 16:20:07.950172 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-8b8b3046-5676-4c25-beec-91e4f8475306 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826211 Nov 24 16:20:07.986239 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:06Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:20:08.013582 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b13672-be82-457c-9a82-43318bc6e548 None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:06Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:20:08.202661 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e16afe0-49f3-41d8-998f-33b60ea45ab5 None None] New status for floating IP 0c779274-dadf-4aa6-89b9-4f51ac27e896: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:20:14.356880 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:18.632789 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-13cfb589-e332-4804-97cc-0fdeaf243643 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:21.291313 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c2049264-c6e8-4b23-90e7-d492aa808e11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:22.688816 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:24.374072 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:24.510779 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:28.499229 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-96cccf64-c852-473f-84fa-ddcc21acdf3a service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0442667 Nov 24 16:20:28.592060 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-a05744e4-62e5-41aa-bcda-d2f5197b2677 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:28.593650 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-a05744e4-62e5-41aa-bcda-d2f5197b2677 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0510240 Nov 24 16:20:28.699554 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-75d3416f-53c6-4a51-9b97-3ee06efda9dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:28.701021 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-75d3416f-53c6-4a51-9b97-3ee06efda9dc service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0854001 Nov 24 16:20:28.771450 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-68dafce3-cf3d-41d8-aa68-4e384cfb7832 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1002 time: 0.0622623 Nov 24 16:20:28.821790 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-d909ff51-978d-4127-a4ae-923b55ac8053 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:28.823199 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-d909ff51-978d-4127-a4ae-923b55ac8053 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0439754 Nov 24 16:20:28.887282 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-29c1d9a6-a469-4781-9b32-5779d0f89dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:20:28.888763 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-29c1d9a6-a469-4781-9b32-5779d0f89dc9 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0577593 Nov 24 16:20:28.983340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-0aa9d09b-817a-4065-8044-10ea3bf69929 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864599 Nov 24 16:20:29.072680 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-01d9defa-7771-4e0c-891c-b7faee4e2477 req-9a916f1f-8d82-4b67-9e71-a0c20a68a9a4 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815508 Nov 24 16:20:42.998499 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:20:44.377345 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:46.666610 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-43318515-929e-4bec-a425-0fd4cac44f1d req-497c64b0-5d7c-466a-9711-ac237bb6fda7 service neutron] (102788) timed out ('10.222.0.71', 55163) {{(pid=102788) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:20:48.634004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0970-a77f-499d-b1ec-875dee1a9459 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:49.665217 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-4f71ab65-143d-44a7-9e31-92e96f180aa7 service neutron] (102787) timed out ('10.222.0.71', 55168) {{(pid=102787) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:20:51.172931 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-9ea94bf5-518e-406c-a16b-aa86dcf10bfe service neutron] (102787) timed out ('10.222.0.71', 55173) {{(pid=102787) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:20:51.292278 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-1c5f7cba-73c5-4422-a0ab-efafbfac1ea4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:52.693076 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:54.376700 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:54.513857 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:14.375914 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:18.636325 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3587a9a8-806a-4682-a877-f5567d49a68e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:19.997163 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:21:20.235593 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-b94f4585-b8a2-48ea-a655-6e7a549d167c req-2f7bf5e2-768a-4dfe-b6f8-93008e615a79 service neutron] (102787) timed out ('10.222.0.71', 55185) {{(pid=102787) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:21:21.293645 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-cd026985-8c8b-4545-b4ac-aa70e8a65b20 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:22.695403 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:24.378556 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:24.516523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:28.960864 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-1d159fe4-ea3c-43f2-bb49-42daf80610ec service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0940702 Nov 24 16:21:29.023921 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-5bd2edd2-a065-4991-a57a-f1bd463af7f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:29.025450 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-5bd2edd2-a065-4991-a57a-f1bd463af7f1 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0411415 Nov 24 16:21:29.131187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-52f96c3b-e8f9-48b3-9f82-64fa5f3f59f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:29.132585 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-52f96c3b-e8f9-48b3-9f82-64fa5f3f59f7 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0880387 Nov 24 16:21:29.200295 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-07569e56-8cf9-4923-a5d5-1f2b8b0a81a5 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 1002 time: 0.0603402 Nov 24 16:21:29.247903 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-0a0e2d1a-3a47-49e6-81df-7ba2a77f0579 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:29.249666 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-0a0e2d1a-3a47-49e6-81df-7ba2a77f0579 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0427916 Nov 24 16:21:29.298976 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-22e6c9e0-3bcc-4800-ad91-6d0bb2385b18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:29.300456 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-22e6c9e0-3bcc-4800-ad91-6d0bb2385b18 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427356 Nov 24 16:21:29.390451 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-45365ad9-c68d-4533-a03f-00e7fa1b161b service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822177 Nov 24 16:21:29.480925 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-9350b859-e8f1-49b0-9ac5-fca40b602ca7 req-d648a8cb-a3c2-4009-b88b-e6df51ac99a1 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830414 Nov 24 16:21:44.401750 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:48.638404 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-dcb40c64-c333-4bcd-aa7c-fe748403a4ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:49.126505 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 req-433b1679-cc39-4891-94da-f3471d041361 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:49.127987 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 req-433b1679-cc39-4891-94da-f3471d041361 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.1062710 Nov 24 16:21:49.177365 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 req-b41b93d6-b4ea-494d-ac9e-2a601f76f867 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423157 Nov 24 16:21:50.351509 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118c11ac-e71e-4922-9b64-0ac6d23d132a req-6a8bc764-18c2-4a6a-ab3d-a2de3b9b3a1e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:50.353011 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-118c11ac-e71e-4922-9b64-0ac6d23d132a req-6a8bc764-18c2-4a6a-ab3d-a2de3b9b3a1e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.1030383 Nov 24 16:21:50.403289 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-118c11ac-e71e-4922-9b64-0ac6d23d132a req-fcbe205b-0c24-4b8e-8149-9abe86b063b0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439811 Nov 24 16:21:51.295244 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-f1145fc2-680c-4402-8c07-b1f98281e2a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:51.540952 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff42e87-eee4-4315-90ad-ba63b5e97461 req-db2eb920-b14a-46d7-9214-8e7979e3257c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:51.542562 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ff42e87-eee4-4315-90ad-ba63b5e97461 req-db2eb920-b14a-46d7-9214-8e7979e3257c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0508995 Nov 24 16:21:51.598781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ff42e87-eee4-4315-90ad-ba63b5e97461 req-a1327d9d-c33c-44de-967c-7ea02789a1c3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494533 Nov 24 16:21:52.699704 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:52.720516 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a150a36-705f-4e57-b2a4-276fa1987345 req-c18ee0fa-d6ce-4e9c-8eff-1c9a2a0cd9ab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:52.722028 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5a150a36-705f-4e57-b2a4-276fa1987345 req-c18ee0fa-d6ce-4e9c-8eff-1c9a2a0cd9ab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0542386 Nov 24 16:21:52.773786 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5a150a36-705f-4e57-b2a4-276fa1987345 req-0663776c-afcf-44d7-a1fb-8e9e6775f27e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452907 Nov 24 16:21:53.897644 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c55621c-8097-4073-9791-db4ae2a39e1a req-e6e246a7-534d-4dab-91ae-f9797dca3eb5 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:53.899191 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c55621c-8097-4073-9791-db4ae2a39e1a req-e6e246a7-534d-4dab-91ae-f9797dca3eb5 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0528119 Nov 24 16:21:53.950957 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c55621c-8097-4073-9791-db4ae2a39e1a req-92edae07-8b6e-4613-a688-15ea2b0697ed tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458336 Nov 24 16:21:54.380890 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:54.518675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:55.067944 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75929f6d-2917-447f-88c7-15560e84764c req-10b9b5ee-99af-4688-8625-ae0b4de474cf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:55.069594 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-75929f6d-2917-447f-88c7-15560e84764c req-10b9b5ee-99af-4688-8625-ae0b4de474cf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0501525 Nov 24 16:21:55.119323 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-75929f6d-2917-447f-88c7-15560e84764c req-0b1e79f6-2e97-4540-847e-d5d89a78d3e2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438409 Nov 24 16:21:56.236801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ec3e06-6d9c-4954-8934-911d6cf12daf req-8b38c346-89d7-44d6-9cec-6eb3789381f8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:56.239009 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b2ec3e06-6d9c-4954-8934-911d6cf12daf req-8b38c346-89d7-44d6-9cec-6eb3789381f8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0522051 Nov 24 16:21:56.290459 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b2ec3e06-6d9c-4954-8934-911d6cf12daf req-c4095e72-055b-44a2-a917-16094b309ac1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455537 Nov 24 16:21:56.996337 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:21:57.413165 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f4b2ee-8001-4137-a500-89bb45ebaaab req-457e3c56-1ade-4eff-b316-c580801aacf3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:57.414727 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88f4b2ee-8001-4137-a500-89bb45ebaaab req-457e3c56-1ade-4eff-b316-c580801aacf3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0552351 Nov 24 16:21:57.468830 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-88f4b2ee-8001-4137-a500-89bb45ebaaab req-bca81efd-d3af-4a26-8175-745d185daf67 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481451 Nov 24 16:21:58.589670 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96ac158-c96c-419a-8576-6ae718ff37b2 req-b93897be-6adf-4cef-b74d-dace7ff1785a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:58.591154 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c96ac158-c96c-419a-8576-6ae718ff37b2 req-b93897be-6adf-4cef-b74d-dace7ff1785a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0530703 Nov 24 16:21:58.642361 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c96ac158-c96c-419a-8576-6ae718ff37b2 req-e7fc56d5-7f4d-4041-94b7-00d1f562db30 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453033 Nov 24 16:21:59.201948 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8332e9-05df-4024-8817-3afe58683760 req-dc4a23f4-e23a-4a8c-848e-f15adce3af96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:59.203443 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-dc4a23f4-e23a-4a8c-848e-f15adce3af96 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0436130 Nov 24 16:21:59.298697 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8332e9-05df-4024-8817-3afe58683760 req-24057291-55e5-406d-8b32-2bc4bf8bb722 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:59.300213 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-24057291-55e5-406d-8b32-2bc4bf8bb722 service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0901971 Nov 24 16:21:59.367338 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-3a7a5156-0e6b-442f-80e9-3f2abcb9626c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1002 time: 0.0596955 Nov 24 16:21:59.416324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8332e9-05df-4024-8817-3afe58683760 req-4a08c398-4c4e-4a56-a107-db002e3f4a88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:59.417801 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-4a08c398-4c4e-4a56-a107-db002e3f4a88 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0439036 Nov 24 16:21:59.472439 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8332e9-05df-4024-8817-3afe58683760 req-4b568d3b-3038-4548-9239-f8459e9f2a84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:59.474850 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-4b568d3b-3038-4548-9239-f8459e9f2a84 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0501940 Nov 24 16:21:59.567264 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-644eb096-8dc1-4741-8b58-7d22fa51c438 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849528 Nov 24 16:21:59.660741 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-2b8332e9-05df-4024-8817-3afe58683760 req-63b0f7e5-ece4-4715-ac72-3533c74da598 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861151 Nov 24 16:21:59.758647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50412ad-2fee-40c2-b914-11e2632c5559 req-bb1d08e5-1ac5-416d-bbbb-9766d9cc5891 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:21:59.760076 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d50412ad-2fee-40c2-b914-11e2632c5559 req-bb1d08e5-1ac5-416d-bbbb-9766d9cc5891 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0500841 Nov 24 16:21:59.809634 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d50412ad-2fee-40c2-b914-11e2632c5559 req-a19f1d24-0eff-42c7-ba31-a91890db502e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434849 Nov 24 16:22:00.926589 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b208814d-2018-48c5-bbeb-c87415333efc req-eb16ff21-f7c2-4fc3-b48f-a6fe648b6644 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:00.928091 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b208814d-2018-48c5-bbeb-c87415333efc req-eb16ff21-f7c2-4fc3-b48f-a6fe648b6644 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0487356 Nov 24 16:22:00.977902 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b208814d-2018-48c5-bbeb-c87415333efc req-eec136e0-3ed5-4fba-8569-cb1d524aec49 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437505 Nov 24 16:22:02.092657 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f0e5c0-c250-41dd-8c37-752dba20aef6 req-8e0acc57-54cc-49df-aa26-23ecd36420f9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:02.094167 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-72f0e5c0-c250-41dd-8c37-752dba20aef6 req-8e0acc57-54cc-49df-aa26-23ecd36420f9 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0486281 Nov 24 16:22:02.148923 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-72f0e5c0-c250-41dd-8c37-752dba20aef6 req-b7415a91-9438-4513-8e45-39c9c5fc6609 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484104 Nov 24 16:22:02.400033 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 req-eb91c252-0715-4df8-8d1a-02d7bfc72e64 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:02.401585 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 req-eb91c252-0715-4df8-8d1a-02d7bfc72e64 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0807786 Nov 24 16:22:02.408998 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-54cb3f16-2d13-463e-802d-0a80ca249a2c service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1169226 Nov 24 16:22:02.421638 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-d893ad99-5e02-4144-8545-b211f0b31ef7 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=102787) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:22:02.422614 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-d893ad99-5e02-4144-8545-b211f0b31ef7 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058143 Nov 24 16:22:02.465453 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 req-4ba7d912-b5e5-40d4-be11-45913cab4d50 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552902 Nov 24 16:22:03.586396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef893ad4-72ca-4965-836b-1c26c1095a78 req-4c859984-50cd-4fd3-bfc7-9352bae7bee3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:03.587920 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ef893ad4-72ca-4965-836b-1c26c1095a78 req-4c859984-50cd-4fd3-bfc7-9352bae7bee3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0488803 Nov 24 16:22:03.645465 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ef893ad4-72ca-4965-836b-1c26c1095a78 req-d97ff68c-75b7-46c0-932e-a0d92142e448 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515838 Nov 24 16:22:04.761015 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b req-f8d49bff-560b-4e1d-87e9-b4e7497e51bf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:04.762538 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b req-f8d49bff-560b-4e1d-87e9-b4e7497e51bf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0495250 Nov 24 16:22:04.821770 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b req-c3ed773d-0d19-4c3c-8ec7-d91d4df5ae1b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520248 Nov 24 16:22:05.788943 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-772d4e2a-f43f-4d67-8af0-ef158c26bba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:05.790460 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-772d4e2a-f43f-4d67-8af0-ef158c26bba9 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b&tenant_id=0e05ec47caaa4b86ba407fd376f503c6 HTTP/1.1" status: 200 len: 1099 time: 0.0481548 Nov 24 16:22:05.850637 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-cf07f60f-e58e-4ffe-a223-c5bdbef41819 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:05.852020 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-cf07f60f-e58e-4ffe-a223-c5bdbef41819 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0403936 Nov 24 16:22:05.857715 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:22:05.934918 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:05.961091 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:05.963682 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50b593d5-05c7-4245-96dc-d568fc0d5ed1" -d '{"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-unplugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:05.977471 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:05.978261 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-a6842a23-e413-4172-9b16-db2116159da6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:05.979786 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-a6842a23-e413-4172-9b16-db2116159da6 service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.1209331 Nov 24 16:22:05.982762 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:05.990212 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148120c2-563c-4472-99eb-039323552ee8 req-0a341570-ed01-413d-96fe-a7135e45cf35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:05.991735 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-148120c2-563c-4472-99eb-039323552ee8 req-0a341570-ed01-413d-96fe-a7135e45cf35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0718787 Nov 24 16:22:06.009315 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f21874a-af92-4f1d-bb19-f205eca0c00e x-openstack-request-id: req-4f21874a-af92-4f1d-bb19-f205eca0c00e {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:06.009696 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-unplugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:06.009910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4f21874a-af92-4f1d-bb19-f205eca0c00e {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:06.010385 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'code': 200} Nov 24 16:22:06.036675 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=6']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:06.043758 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.044119 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.044463 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.044802 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.045169 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.045509 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.045844 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.046173 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.046519 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.046847 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.047173 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.047497 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:06.085925 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-f9a63ad8-6057-4dff-8ae1-115cb32541ff service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1000 time: 0.0931904 Nov 24 16:22:06.090008 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-148120c2-563c-4472-99eb-039323552ee8 req-28f52b33-2223-493a-b60f-efc39f0d641a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0906847 Nov 24 16:22:06.135815 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-1fa41ddf-9a1b-4fff-a7a0-5a6bfec36c62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:06.137311 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-1fa41ddf-9a1b-4fff-a7a0-5a6bfec36c62 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0444643 Nov 24 16:22:06.182812 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-363798ab-7eaf-437b-b787-c47ce6ea36ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:06.184323 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-363798ab-7eaf-437b-b787-c47ce6ea36ea service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404854 Nov 24 16:22:06.274731 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-81d849e5-50ee-4ac4-a638-6310c3c0c854 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830624 Nov 24 16:22:06.362918 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b req-79345b42-dc2a-4228-b123-1b217eb44298 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799096 Nov 24 16:22:07.210091 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee356c07-8704-4801-b49d-df6922b7fcad req-15517591-abf6-447c-afb8-b8b7cc4a4141 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:07.211624 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ee356c07-8704-4801-b49d-df6922b7fcad req-15517591-abf6-447c-afb8-b8b7cc4a4141 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0525582 Nov 24 16:22:07.262957 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ee356c07-8704-4801-b49d-df6922b7fcad req-e2313124-d362-4344-9093-aebaf272d282 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452032 Nov 24 16:22:08.384144 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae9900b-2182-4000-b13b-8e13b6567e72 req-53e380d6-cfb9-463b-ad0d-fbd296959191 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:08.385638 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fae9900b-2182-4000-b13b-8e13b6567e72 req-53e380d6-cfb9-463b-ad0d-fbd296959191 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0544415 Nov 24 16:22:08.434127 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-fae9900b-2182-4000-b13b-8e13b6567e72 req-316e1d5f-ea12-431a-9995-96e1251d10c1 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425649 Nov 24 16:22:09.552819 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb3a17d-3708-459c-9026-1bff6c276441 req-41e04036-5d17-4ef1-ba00-fa5c49b320b5 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:09.554607 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-afb3a17d-3708-459c-9026-1bff6c276441 req-41e04036-5d17-4ef1-ba00-fa5c49b320b5 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0523376 Nov 24 16:22:09.604677 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-afb3a17d-3708-459c-9026-1bff6c276441 req-a0aaab79-5ba8-4c1b-bca7-bfb2acf9280a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439169 Nov 24 16:22:10.721636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54766a0-23c6-42ce-9744-4533bee21b2c req-754fe5d8-fe27-4f74-bd71-a523ed686a37 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:10.723137 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c54766a0-23c6-42ce-9744-4533bee21b2c req-754fe5d8-fe27-4f74-bd71-a523ed686a37 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0480170 Nov 24 16:22:10.772507 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c54766a0-23c6-42ce-9744-4533bee21b2c req-cc7803e3-e69d-422d-8c6b-29aa2182e88e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434685 Nov 24 16:22:11.891218 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2684f06b-46fc-442b-ab88-019cea74ab3c req-d508994f-578a-4b14-a9e4-a01d3f58f0b0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:11.892680 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2684f06b-46fc-442b-ab88-019cea74ab3c req-d508994f-578a-4b14-a9e4-a01d3f58f0b0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0518970 Nov 24 16:22:11.951913 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-2684f06b-46fc-442b-ab88-019cea74ab3c req-83d3d42d-cf9d-448b-8176-8122ded50ab0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531201 Nov 24 16:22:13.065308 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02064de4-6822-4a09-866b-cef0e8ab6f73 req-f9f8ca36-9460-465b-be5e-3203864a87cc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:13.067884 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-02064de4-6822-4a09-866b-cef0e8ab6f73 req-f9f8ca36-9460-465b-be5e-3203864a87cc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0491362 Nov 24 16:22:13.120040 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-02064de4-6822-4a09-866b-cef0e8ab6f73 req-f7228af2-9ef3-48cc-ae25-4e2d0bea4d40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460360 Nov 24 16:22:14.234885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b541ac2-161f-4805-8594-7b0853e9fb4f req-640e9a2c-81af-46a8-900e-b93820e2dc65 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:14.236362 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4b541ac2-161f-4805-8594-7b0853e9fb4f req-640e9a2c-81af-46a8-900e-b93820e2dc65 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0498562 Nov 24 16:22:14.287528 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4b541ac2-161f-4805-8594-7b0853e9fb4f req-7541fc1d-bcb0-430e-97d6-363f037038ef tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443780 Nov 24 16:22:14.406723 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:15.247646 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5109cf82-ec1b-4094-8e8c-0117629e734b req-f2c55624-e3fc-4483-bbff-56eec915180a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:15.249636 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5109cf82-ec1b-4094-8e8c-0117629e734b req-f2c55624-e3fc-4483-bbff-56eec915180a service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1097 time: 0.0455484 Nov 24 16:22:15.295294 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5109cf82-ec1b-4094-8e8c-0117629e734b req-5aa26f8d-74ad-4dd9-90e1-4660aceeb772 service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389159 Nov 24 16:22:15.409935 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 req-832678cc-59a2-465e-8281-0be5af94eaf3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:15.411897 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 req-832678cc-59a2-465e-8281-0be5af94eaf3 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0520840 Nov 24 16:22:15.462915 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 req-affa6adc-3d68-49d0-bc1a-b4e4882e52a4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447469 Nov 24 16:22:16.584800 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd req-43f7739c-2109-4feb-a03c-14deb029822a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:16.586309 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd req-43f7739c-2109-4feb-a03c-14deb029822a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0537469 Nov 24 16:22:16.644118 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd req-2af63512-454c-4c0e-93f3-93842b9a2035 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517910 Nov 24 16:22:17.764406 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-644ddab5-550b-4478-b26e-0e5cf04d98f2 req-2dcd78b6-b2c7-4e75-8116-9892f8aca40a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:17.765806 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-644ddab5-550b-4478-b26e-0e5cf04d98f2 req-2dcd78b6-b2c7-4e75-8116-9892f8aca40a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 944 time: 0.0515516 Nov 24 16:22:17.816821 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-644ddab5-550b-4478-b26e-0e5cf04d98f2 req-0ec589de-c9a3-48e6-ba50-3d3061c06a60 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445840 Nov 24 16:22:17.903418 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:22:18.000452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:18.011534 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'port_id': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'mac_address': 'fa:16:3e:06:c3:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1048, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:22:18.048039 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.061464 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3762c609-4d3f-4e0f-a146-c0077e3c9f5c {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:18.080008 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:18.084253 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.134483 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=7']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:18.639614 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-372380ff-fed3-4f1a-93f2-acb06c18534f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.671558 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['3762c609-4d3f-4e0f-a146-c0077e3c9f5c'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:22:19.904133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:19.951133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:19.951505 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.031505 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.055569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:20.058104 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce" -d '{"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:20.071572 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:20.076269 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.101444 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ecd167e8-dbc2-4611-9d22-253355f265ab x-openstack-request-id: req-ecd167e8-dbc2-4611-9d22-253355f265ab {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:20.101743 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:20.102002 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-ecd167e8-dbc2-4611-9d22-253355f265ab {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:20.102394 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'code': 200} Nov 24 16:22:20.128627 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=8']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.818041 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-6950a8f6-8d34-4bd6-a506-56bb7713996f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-504417305&fields=id&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 267 time: 0.0432115 Nov 24 16:22:20.926970 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-4da6aa12-4a61-4db3-b7fd-b524f37fa26c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:20.928426 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-4da6aa12-4a61-4db3-b7fd-b524f37fa26c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1033359 Nov 24 16:22:20.943448 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-07e411dc-180c-4754-a335-89c029a2369a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/quotas/7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 375 time: 0.0091555 Nov 24 16:22:21.001218 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-b8c64eb9-6f34-4317-92a3-f4550c2f4255 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0484185 Nov 24 16:22:21.097942 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-1b7022b1-c2fe-4e74-b6a6-63d384222a8b service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842576 Nov 24 16:22:21.194110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-82113afe-762b-4816-8cf6-70df3b0e4008 service neutron] 10.222.0.72 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883143 Nov 24 16:22:21.299086 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-edffccb8-ad2c-4c6d-ab8c-63471f723314 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.474137 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4267ccc5-35fc-42da-a17d-6b8872a7ffb5 req-e5f7fa10-c62c-4cdb-bd90-7cb35f22ee97 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 210 time: 0.0259824 Nov 24 16:22:22.384846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-23ec80bf-5ed4-4cbd-b8b7-899934a02891 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:22.386317 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-23ec80bf-5ed4-4cbd-b8b7-899934a02891 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 812 time: 0.1075909 Nov 24 16:22:22.455756 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-f5bc37a2-28ed-4727-a8b4-2f5459740f3f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7ae2d50102bf491986834edf07a6a868 HTTP/1.1" status: 200 len: 379 time: 0.0607309 Nov 24 16:22:22.465074 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'port': {'device_id': 'e5d37abd-923b-419b-805e-303baf82ea67', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'admin_state_up': True, 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'security_groups': ['2d157481-120f-42c9-be9e-2b8cef9b61c9']}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:22.578627 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 req-e909ac64-8921-4dae-88fb-485f319a66b4 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 210 time: 0.0369341 Nov 24 16:22:22.595359 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Made reservation on behalf of 7ae2d50102bf491986834edf07a6a868 for: {'port': 1} {{(pid=102788) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:22.599732 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.703260 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.722365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.20.0.12 (e94d2a4c-106b-44d2-b8a7-a2440253d60c/d3f57000-e20c-491a-8f21-32857a544343/5fb88ff0-bd58-4f17-b36d-7ceece933b04) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:22.865701 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.899351 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.942196 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:22.945081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:22.949160 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:22.955395 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:22.987895 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.988162 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.988502 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.989440 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.989723 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.990245 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.990577 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.990901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.991229 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.991555 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.991874 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:22.992187 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:23.024136 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:23.024794 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.041942 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-fecdca12-b3c7-4184-9f87-f6817b56f872 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5806072 Nov 24 16:22:23.062096 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Request body: {'port': {'device_id': 'e5d37abd-923b-419b-805e-303baf82ea67', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81899'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:23.116504 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.152031 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-d6f44500-8b3a-4c1f-92af-5d63e15b924c None None] Provisioning complete for port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 triggered by entity DHCP. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:23.152409 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d6f44500-8b3a-4c1f-92af-5d63e15b924c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.190507 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-d6f44500-8b3a-4c1f-92af-5d63e15b924c None None] Port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 cannot update to ACTIVE because it is not bound. {{(pid=102789) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:23.622919 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5fb88ff0-bd58-4f17-b36d-7ceece933b04 {{(pid=102788) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:23.630915 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.643162 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.provisioning_blocks [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Transition to ACTIVE for port object 5fb88ff0-bd58-4f17-b36d-7ceece933b04 will not be triggered until provisioned by entity L2. {{(pid=102788) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:23.648152 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.699085 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275d93fc-a28b-4742-b2c4-16472a54fa19 req-3bbb27fe-9145-4bdd-ae34-772bdf94096b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:23.700670 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-275d93fc-a28b-4742-b2c4-16472a54fa19 req-3bbb27fe-9145-4bdd-ae34-772bdf94096b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0502396 Nov 24 16:22:23.733472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Pushing event updated for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.769307 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-275d93fc-a28b-4742-b2c4-16472a54fa19 req-374347fc-759b-4fd5-8ccb-8f2b081a16ca tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0564635 Nov 24 16:22:23.793688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Attempting to bind port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 on host hv-cinder-81899 for vnic_type normal with profile {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:23.794007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Attempting to bind port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 by drivers openvswitch,hyperv on host hv-cinder-81899 at level 0 using segments [{'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:23.794319 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Attempting to bind port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:23.799100 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81899 {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:23.799510 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Attempting to bind port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 on network e94d2a4c-106b-44d2-b8a7-a2440253d60c {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:23.805494 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Checking agent: {'id': '9576e99f-f7fb-42ab-ae67-3e09e4fef2e8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81899', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 24, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:23.805829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Checking segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102788) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:23.806216 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Bound using segment: {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'} {{(pid=102788) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:23.806636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.managers [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Bound port: 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host: hv-cinder-81899, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f483b91-e552-422c-aad1-7b8f845efd1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1010, 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c'}}] {{(pid=102788) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:23.806987 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.871184 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, cleared binding levels {{(pid=102788) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:23.874191 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:23.878969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.916677 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:23.917377 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.918781 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] 10.222.0.71 "PUT /v2.0/ports/5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 200 len: 1094 time: 0.8618190 Nov 24 16:22:23.919213 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:23.921458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69844ce1-dcaf-49ae-8343-8896b15b849e" -d '{"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:23.959087 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc6d69f-ae23-465f-840c-8af160973174 service neutron] Pushing event updated for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=3']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:24.017636 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-a22854bc-9997-492b-b555-182208a03a92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:24.019138 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-a22854bc-9997-492b-b555-182208a03a92 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1097 time: 0.0499244 Nov 24 16:22:24.064373 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-55572845-6084-419a-b708-9b85cc6f70ec service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 200 len: 217 time: 0.0355599 Nov 24 16:22:24.117056 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-6182b21f-e67f-46cf-a8ca-5c7f2bd5f2e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:24.118464 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-6182b21f-e67f-46cf-a8ca-5c7f2bd5f2e4 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0474217 Nov 24 16:22:24.163691 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-eb213c28-7709-4dee-b585-b8ef822ad593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:24.165183 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-eb213c28-7709-4dee-b585-b8ef822ad593 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398924 Nov 24 16:22:24.254630 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-7c3e9633-be90-4335-8f91-d429df68b5ac service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825446 Nov 24 16:22:24.346178 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 req-f331cd33-0bcf-448f-9400-53a64f03b788 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846617 Nov 24 16:22:24.382942 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.522769 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.890121 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 req-6c753e3d-9b1b-45e7-b674-0ab83ec1cdd1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:24.891577 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 req-6c753e3d-9b1b-45e7-b674-0ab83ec1cdd1 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0517654 Nov 24 16:22:24.939987 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 req-7bfd795f-2ec2-479d-9f09-cfa2c45c50a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415056 Nov 24 16:22:25.049799 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 x-openstack-request-id: req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:25.050305 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:25.050305 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:25.050691 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'status': 'completed', 'code': 200} Nov 24 16:22:25.112672 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-6586f85c-1ffb-4671-b194-eba6739390ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:25.114877 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-6586f85c-1ffb-4671-b194-eba6739390ad service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1097 time: 0.0407012 Nov 24 16:22:25.214830 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-a39d1c85-979b-4ac1-876f-08672dfdd0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:25.216264 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-a39d1c85-979b-4ac1-876f-08672dfdd0ef service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0942209 Nov 24 16:22:25.258829 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-3b683a4c-0e40-41d4-9893-250bc62d6a42 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 200 len: 217 time: 0.0336049 Nov 24 16:22:25.315961 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-652e1664-b00c-4484-b18c-343929cdfe97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:25.318040 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-652e1664-b00c-4484-b18c-343929cdfe97 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0475447 Nov 24 16:22:25.368306 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32391006-6c99-4515-9512-f2cfb14635d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:25.369801 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32391006-6c99-4515-9512-f2cfb14635d4 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0406399 Nov 24 16:22:25.458551 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-34e94ec2-81c0-4e30-8e71-207a1be83931 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782421 Nov 24 16:22:25.548532 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-bf3e60eb-f047-4d9c-912f-56f111a80253 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825281 Nov 24 16:22:26.054019 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed req-37264702-6ccd-4a78-9ade-31edf3d54cfa tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:26.055501 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed req-37264702-6ccd-4a78-9ade-31edf3d54cfa tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0487990 Nov 24 16:22:26.105397 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed req-84d7d8f7-97f2-4403-af40-b5b7d46ddfbd tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439973 Nov 24 16:22:27.220027 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e req-8dec4c15-a733-4acf-b927-e006dd56954a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:27.221547 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e req-8dec4c15-a733-4acf-b927-e006dd56954a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0485811 Nov 24 16:22:27.271950 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e req-7ebca859-1880-429c-93bf-5a2d2342e8fe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434582 Nov 24 16:22:28.391620 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 req-d5349914-b664-4152-8ec3-f0cb8a1058dc tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:28.393127 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 req-d5349914-b664-4152-8ec3-f0cb8a1058dc tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0542786 Nov 24 16:22:28.446866 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 req-0993ba12-4f55-4ff5-a9c1-542f2f080905 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476651 Nov 24 16:22:29.565972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23fc992c-f9a6-49f9-814d-ebd2622fa908 req-275d6b85-59f1-4b51-bca6-04a5111d6f98 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:29.567800 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-23fc992c-f9a6-49f9-814d-ebd2622fa908 req-275d6b85-59f1-4b51-bca6-04a5111d6f98 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0535843 Nov 24 16:22:29.617624 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-23fc992c-f9a6-49f9-814d-ebd2622fa908 req-eb109f4f-1e27-458e-8c69-4de8bea9fa0a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436394 Nov 24 16:22:30.733359 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e784271-5281-472c-affe-b0d217144696 req-19364a95-edf1-49e4-ba80-51192a53ec98 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:30.734877 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0e784271-5281-472c-affe-b0d217144696 req-19364a95-edf1-49e4-ba80-51192a53ec98 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0494161 Nov 24 16:22:30.786895 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-0e784271-5281-472c-affe-b0d217144696 req-4aa9701a-6da1-487f-9f7f-1e4f830add6d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454247 Nov 24 16:22:30.896611 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-dfd01b94-0fd3-4143-9f91-72953b4cd561 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401618 Nov 24 16:22:30.980328 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c36976-1fab-412a-bed3-56c8c389484b req-f4da64b4-c15c-40b8-bce7-2e9c83a8c335 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:30.981826 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-f4da64b4-c15c-40b8-bce7-2e9c83a8c335 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0405533 Nov 24 16:22:31.090295 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c36976-1fab-412a-bed3-56c8c389484b req-97300019-e95e-4a47-a005-4afb53816e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:31.091745 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-97300019-e95e-4a47-a005-4afb53816e21 service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0902689 Nov 24 16:22:31.157196 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-7a197c5a-2487-4b51-88e6-c9f7da96da1e service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 1002 time: 0.0562727 Nov 24 16:22:31.210148 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c36976-1fab-412a-bed3-56c8c389484b req-2e77792b-38ee-41ce-83bc-26c5b5d45189 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:31.211629 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-2e77792b-38ee-41ce-83bc-26c5b5d45189 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0469437 Nov 24 16:22:31.258242 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c36976-1fab-412a-bed3-56c8c389484b req-c8fc23f3-052e-4172-861f-49b7fee22b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:31.259827 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-c8fc23f3-052e-4172-861f-49b7fee22b71 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411196 Nov 24 16:22:31.362406 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-3e8cc4a4-1c9a-406b-bb87-e7072c1df6e3 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899417 Nov 24 16:22:31.455846 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-91c36976-1fab-412a-bed3-56c8c389484b req-30473a3f-eee6-44af-bf71-843fc4d6cd66 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854862 Nov 24 16:22:31.903146 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1412267f-3b7a-4db6-8974-af4ce4409329 req-9b191b56-54d6-44da-a7f3-8cbbc722a02a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:31.904628 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1412267f-3b7a-4db6-8974-af4ce4409329 req-9b191b56-54d6-44da-a7f3-8cbbc722a02a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0502880 Nov 24 16:22:31.953257 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-1412267f-3b7a-4db6-8974-af4ce4409329 req-e7f44b1b-279e-4def-ae45-0ea54678a7b5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424154 Nov 24 16:22:33.069825 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd3e211-dcc5-4188-a399-080a3c6b3582 req-fa79d924-3cb6-4d76-a31d-24f2b3546815 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:33.071312 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecd3e211-dcc5-4188-a399-080a3c6b3582 req-fa79d924-3cb6-4d76-a31d-24f2b3546815 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0479820 Nov 24 16:22:33.119139 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ecd3e211-dcc5-4188-a399-080a3c6b3582 req-612d7828-70f0-4b43-84ff-f2b4b9f09a32 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418518 Nov 24 16:22:33.982158 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 5fb88ff0-bd58-4f17-b36d-7ceece933b04 details requested by agent hyperv_hv-cinder-81899 with host hv-cinder-81899 {{(pid=102789) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:22:33.994995 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:22:34.196968 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:34.208004 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Returning: {'device': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'port_id': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'mac_address': 'fa:16:3e:3e:15:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1010, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102789) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:22:34.238801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7789811-651e-4eae-be83-0b8a5a8efb2a req-5bacb6fa-488f-4aab-90fb-2b1a4bc6d9fe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:34.240249 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f7789811-651e-4eae-be83-0b8a5a8efb2a req-5bacb6fa-488f-4aab-90fb-2b1a4bc6d9fe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 944 time: 0.0536892 Nov 24 16:22:34.247640 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.261860 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5fb88ff0-bd58-4f17-b36d-7ceece933b04 {{(pid=102789) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:34.282649 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:34.287227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.292715 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-f7789811-651e-4eae-be83-0b8a5a8efb2a req-2a5df864-30ac-4eab-85b5-9cdb31392d88 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462601 Nov 24 16:22:34.333693 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=4']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:34.649567 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] get_ports_and_sgs() called for port_ids ['5fb88ff0-bd58-4f17-b36d-7ceece933b04'] {{(pid=102789) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:22:35.412914 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9992e9af-794b-4055-8963-8d52adcbff5c req-a08c7282-5f7a-4640-aef0-e167a0944e94 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:35.414423 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9992e9af-794b-4055-8963-8d52adcbff5c req-a08c7282-5f7a-4640-aef0-e167a0944e94 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 945 time: 0.0553584 Nov 24 16:22:35.464119 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-9992e9af-794b-4055-8963-8d52adcbff5c req-eb3c21ed-c32c-4ec3-a5a8-8e8873be8879 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435710 Nov 24 16:22:35.995236 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 5fb88ff0-bd58-4f17-b36d-7ceece933b04 up at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:36.054359 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning for port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 completed by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:22:36.058624 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.provisioning_blocks [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Provisioning complete for port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 triggered by entity L2. {{(pid=102789) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:36.058981 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-654981'] for port, provisioning_complete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.138530 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.160988 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04'}] {{(pid=102789) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:36.163433 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5a489c5518e8d27b6b0d57dfc672656ae5a4a7cf09569a547f4925fad4864d2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d" -d '{"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-plugged", "status": "completed", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]}' {{(pid=102789) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:36.178610 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:36.183309 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436'] for port, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.205515 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d102805a-15f9-4a17-b121-d67df0cb972b x-openstack-request-id: req-d102805a-15f9-4a17-b121-d67df0cb972b {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:36.205808 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-plugged", "status": "completed", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04", "code": 200}]} {{(pid=102789) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:36.206062 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-d102805a-15f9-4a17-b121-d67df0cb972b {{(pid=102789) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:36.206444 dv-cinder-818994-2-iscsi neutron-server[102789]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'code': 200} Nov 24 16:22:36.235545 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Pushing event updated for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=5']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:36.446125 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ac5adb-9842-4e44-8e09-7e0e94882f95 req-2b92a2d5-ce78-4d98-a660-300abf323d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:36.447631 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-41ac5adb-9842-4e44-8e09-7e0e94882f95 req-2b92a2d5-ce78-4d98-a660-300abf323d84 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1099 time: 0.0433185 Nov 24 16:22:36.493287 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-41ac5adb-9842-4e44-8e09-7e0e94882f95 req-604c654f-d775-4c79-8c46-440bf8da2cce service neutron] 10.222.0.71 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386767 Nov 24 16:22:36.579819 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef697f9-4212-49f1-b75e-c1f636d0c192 req-458aac37-2f16-47a3-840a-779345a4ecb4 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:36.581308 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4ef697f9-4212-49f1-b75e-c1f636d0c192 req-458aac37-2f16-47a3-840a-779345a4ecb4 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0496240 Nov 24 16:22:36.635164 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-4ef697f9-4212-49f1-b75e-c1f636d0c192 req-d37834e4-fa14-49af-97ab-b6b6568986a3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470254 Nov 24 16:22:37.751883 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 req-482da007-ede3-4e16-89ae-062ee4215319 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:37.753415 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 req-482da007-ede3-4e16-89ae-062ee4215319 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0491302 Nov 24 16:22:37.808326 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 req-faa9b109-d6fc-4945-a400-0c9b37eb4ebc tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484202 Nov 24 16:22:38.923514 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25648fa-cbce-47e7-b645-ca39edbe109d req-a1059457-8813-4dcb-aa29-13a649299900 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:38.924955 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d25648fa-cbce-47e7-b645-ca39edbe109d req-a1059457-8813-4dcb-aa29-13a649299900 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0469205 Nov 24 16:22:38.978447 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-d25648fa-cbce-47e7-b645-ca39edbe109d req-75ad5680-7df1-4b70-823c-a0922d69564e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465741 Nov 24 16:22:39.093347 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c125d4-0736-45da-a734-9188baa23753 req-5fbd12cf-ca40-4b97-97c0-92dfc173f465 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:39.094743 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6c125d4-0736-45da-a734-9188baa23753 req-5fbd12cf-ca40-4b97-97c0-92dfc173f465 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0501857 Nov 24 16:22:39.143743 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a6c125d4-0736-45da-a734-9188baa23753 req-d23d3885-4c14-4c33-abf2-977e532794a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424545 Nov 24 16:22:39.166349 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42374) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:39.307237 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-636412bf-097b-47fb-8b73-46134c912a2c tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:39.309168 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-636412bf-097b-47fb-8b73-46134c912a2c tempest-TestVolumeBootPattern-1422244105 tempest-TestVolumeBootPattern-1422244105-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1094 time: 0.1414263 Nov 24 16:22:39.311676 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42378) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:39.316442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.v2.base [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Request body: {'floatingip': {'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'port_id': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102788) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:39.346972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.447530 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.548972 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_common [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Allocated IP 172.27.0.90 (b30ec751-e8b3-4e51-a19c-98cbd4d210ff/824670b0-d537-4fe9-a92d-99c6238378a4/9f7779ce-7633-4762-914a-f7957325580b) {{(pid=102788) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:39.656007 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.689702 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8794868178396', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.724765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Network b30ec751-e8b3-4e51-a19c-98cbd4d210ff is already hosted by enough agents. {{(pid=102788) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:39.729375 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.base_scheduler [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Resources bound (agent type, host, resource id): {{(pid=102788) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:39.732699 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Received port after_create {{(pid=102788) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:39.756164 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=9f7779ce-7633-4762-914a-f7957325580b,revision_number=1']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:40.085478 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.159550 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-630158'] for port, before_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.307995 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for port, precommit_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.312783 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8794868609774', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8794868178414', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8794868178436', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29518386'] for port, after_update {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.383793 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event updated for resources: {'Port': ['ID=9f7779ce-7633-4762-914a-f7957325580b,revision_number=2']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:40.393399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33288113'] for floatingip, after_create {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.495909 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 8d47c460-8c8f-4f48-b41a-f524fd4037c5 associated. External IP: 172.27.0.90, port: 5fb88ff0-bd58-4f17-b36d-7ceece933b04. Nov 24 16:22:40.694081 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:22:40.799437 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:40.809619 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:40.817510 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.823835 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:40.824462 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:22:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:40.844556 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-fc18e8de-0162-4fa4-abed-bb51aad4c6bb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5316217 Nov 24 16:22:40.845108 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:40.847345 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d81677d8-4155-4d53-a3cd-20c7c07f70b8" -d '{"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:40.882776 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15e36acc-e1bc-4525-862e-dfb1a9198efe x-openstack-request-id: req-15e36acc-e1bc-4525-862e-dfb1a9198efe {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:40.883070 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:40.883326 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-15e36acc-e1bc-4525-862e-dfb1a9198efe {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:40.883732 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'status': 'completed', 'code': 200} Nov 24 16:22:40.932174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:40.951956 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-b39ea1bd-664e-49f8-8afa-4a49abb9a69f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:40.953383 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-b39ea1bd-664e-49f8-8afa-4a49abb9a69f service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1099 time: 0.0442543 Nov 24 16:22:41.046661 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-058c2d11-5768-4c7a-be4e-4eaf67fa800d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:41.048114 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-058c2d11-5768-4c7a-be4e-4eaf67fa800d service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0843742 Nov 24 16:22:41.117888 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-240a64e0-2bd9-40a9-92c2-b0a308586a80 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 200 len: 999 time: 0.0613639 Nov 24 16:22:41.154801 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}, {'id': '8d47c460-8c8f-4f48-b41a-f524fd4037c5', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.90', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:3e:15:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5d37abd-923b-419b-805e-303baf82ea67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:39Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:41.165717 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-2f87a9a2-8523-4614-ba9c-0889f21eca1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:41.167166 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-2f87a9a2-8523-4614-ba9c-0889f21eca1f service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0423656 Nov 24 16:22:41.181393 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:41.189844 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:41.190447 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:22:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:41.213861 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-f68d88b9-a36c-465f-a751-6ee3a9f65162 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:41.215370 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-f68d88b9-a36c-465f-a751-6ee3a9f65162 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405090 Nov 24 16:22:41.297258 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:41.309208 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-4bea0e0f-6d81-4ef0-8020-ad8d2d8a8954 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852549 Nov 24 16:22:41.400332 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-78aa9dd7-9caa-44ef-8d19-d19c243cd3c3 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826120 Nov 24 16:22:41.527105 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}, {'id': '8d47c460-8c8f-4f48-b41a-f524fd4037c5', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.90', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:3e:15:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5d37abd-923b-419b-805e-303baf82ea67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:39Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:41.553654 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd2c9ed5-1173-4757-87e6-f0a26e327e33 None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}, {'id': '8d47c460-8c8f-4f48-b41a-f524fd4037c5', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.90', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:3e:15:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5d37abd-923b-419b-805e-303baf82ea67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:39Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 0, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:41.746497 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44dc5323-99c4-47ec-affe-a9598886a4e0 None None] New status for floating IP 8d47c460-8c8f-4f48-b41a-f524fd4037c5: ACTIVE {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:22:44.432653 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.643447 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-47a24021-95bb-4fdf-afe0-8d72c66343a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.302316 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a18e0b37-fd9b-4387-90b3-9ed749f4300d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.705923 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.385308 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.524111 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:10.994509 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:23:14.422145 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:18.645051 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-e400fef7-b1cf-4ddc-b05c-e876f843cab3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.303792 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-96f32f44-cab9-492a-9ff1-51381180c1bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.708061 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:24.387082 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:24.525568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:32.930340 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-07fa6f66-78b8-42d9-8880-8249b6297a3a service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0511010 Nov 24 16:23:32.996299 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269251a2-c40e-4294-ac8b-6aac843851dd req-a923454d-4d6c-4905-88a3-9b6567430863 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:32.997805 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-a923454d-4d6c-4905-88a3-9b6567430863 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0398781 Nov 24 16:23:33.098763 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269251a2-c40e-4294-ac8b-6aac843851dd req-ed5d5b3a-9c39-4702-9493-4f2f9249f7d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:33.100413 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-ed5d5b3a-9c39-4702-9493-4f2f9249f7d4 service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0822444 Nov 24 16:23:33.167157 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-b7e4be17-05fe-462e-aa01-566b058db131 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 1002 time: 0.0600035 Nov 24 16:23:33.217042 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269251a2-c40e-4294-ac8b-6aac843851dd req-a111ea28-b2e0-4354-acf9-4a311b1e7c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:33.218533 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-a111ea28-b2e0-4354-acf9-4a311b1e7c74 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0445054 Nov 24 16:23:33.263514 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269251a2-c40e-4294-ac8b-6aac843851dd req-d9ca420c-7535-4122-8938-874dd0772ce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:33.264956 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-d9ca420c-7535-4122-8938-874dd0772ce8 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395317 Nov 24 16:23:33.354454 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-bfdb57ff-a41f-48c0-9a8c-9453573525de service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820124 Nov 24 16:23:33.443152 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-269251a2-c40e-4294-ac8b-6aac843851dd req-054a8f44-7690-43e6-a237-4b04c79d3fb6 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803266 Nov 24 16:23:44.437227 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.993801 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:23:48.649472 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d319030b-296a-4743-93e7-e63401856827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.304412 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6ea305a9-f5bd-467f-8ba2-55272f54563a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.713108 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.217934 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42422) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:54.391681 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.529110 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.662576 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Deleting port b8948ad1-d27a-4a2a-a14f-3a9ea8edee28 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:23:54.662966 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.734274 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.734601 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.746407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling delete_port for b8948ad1-d27a-4a2a-a14f-3a9ea8edee28 owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:23:54.887917 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.913888 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event deleted for resources: {'Port': ['ID=b8948ad1-d27a-4a2a-a14f-3a9ea8edee28,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:54.935758 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.936111 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.936457 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.936795 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.937160 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.937497 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.937825 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.938152 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.938479 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.938806 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.939133 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.939453 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102788) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:54.978982 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:54.979320 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Floating IP 604022b0-48e7-4f1f-8e7d-48124f4e5f59 disassociated (deleted). External IP: 172.27.0.124, port: 3762c609-4d3f-4e0f-a146-c0077e3c9f5c. Nov 24 16:23:55.179746 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Router 1f3aee64-2d5d-4b44-a102-e57424d0c018 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:23:55.282894 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:23:55.287364 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:55.293273 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Sync routers for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:23:55.303561 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:55.304883 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:55.316343 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-fb0785a1-876f-4f77-bd42-4570dce4cdbf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "DELETE /v2.0/floatingips/604022b0-48e7-4f1f-8e7d-48124f4e5f59 HTTP/1.1" status: 204 len: 168 time: 1.0973229 Nov 24 16:23:55.316923 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:55.319713 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0" -d '{"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:55.361504 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a818d28-be13-495a-9278-b29407d7efb1 x-openstack-request-id: req-7a818d28-be13-495a-9278-b29407d7efb1 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:55.361827 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:55.362120 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-7a818d28-be13-495a-9278-b29407d7efb1 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:55.362533 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'status': 'completed', 'code': 200} Nov 24 16:23:55.433649 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-cd2d286c-2e79-417c-ae3b-535eae55a29d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.436174 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-cd2d286c-2e79-417c-ae3b-535eae55a29d service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 1099 time: 0.0506382 Nov 24 16:23:55.538289 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-e594b5dd-9093-4aa9-b6db-fc3ba66278ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.540034 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-e594b5dd-9093-4aa9-b6db-fc3ba66278ad service neutron] 10.222.0.71 "GET /v2.0/networks?id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 200 len: 910 time: 0.0959020 Nov 24 16:23:55.545447 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:55.568456 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d req-83698768-b8d2-432d-ab1a-f34a326e15e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.570242 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d req-83698768-b8d2-432d-ab1a-f34a326e15e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0521038 Nov 24 16:23:55.587920 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-d7d96d14-8c23-4e6f-a672-8b4598721e6c service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 200 len: 217 time: 0.0403547 Nov 24 16:23:55.623219 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d req-1160933e-d834-4a6a-934d-cee13ae65e2b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469954 Nov 24 16:23:55.644602 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-5d011f6f-7c67-4df9-b329-106e0a42b0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.646426 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-5d011f6f-7c67-4df9-b329-106e0a42b0ee service neutron] 10.222.0.71 "GET /v2.0/subnets?id=9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 200 len: 847 time: 0.0513003 Nov 24 16:23:55.692828 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-089358e0-8c44-4998-9f76-3c63b76e9799 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.694359 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-089358e0-8c44-4998-9f76-3c63b76e9799 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=7adfa203-bbb1-4530-a8be-f1ebfa6654ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407224 Nov 24 16:23:55.756980 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:55.782794 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Checking router: 1f3aee64-2d5d-4b44-a102-e57424d0c018 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:23:55.787405 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-0f658666-f742-4d69-a9bd-4fcd006493bc service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857050 Nov 24 16:23:55.791754 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:55.792361 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:55.876543 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-55082911-52b8-4873-9265-2536aa5c23e1 service neutron] 10.222.0.71 "GET /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812187 Nov 24 16:23:55.899228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:56.109374 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:56.136097 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70775b7e-a533-4955-a4e5-d38c3467921e None None] The sync data for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi is: [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:47Z', 'revision_number': 4, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': '5bb1a2e0-3ca6-436b-b3eb-f131740dad8c', 'name': '', 'network_id': '7adfa203-bbb1-4530-a8be-f1ebfa6654ca', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'mac_address': 'fa:16:3e:c8:8d:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:47Z', 'updated_at': '2021-11-24T16:18:52Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'subnets': [{'id': '9fe1060b-8118-4779-9a4d-1c167ac19e40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:23:56.351300 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da6c7a30-29aa-4216-b94a-cc3cb213ac8c None None] New status for floating IP 604022b0-48e7-4f1f-8e7d-48124f4e5f59: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:23:56.742442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d778227a-dafd-4896-a0ae-42d943fd670f req-318e44c4-1d1a-4d12-a408-783214744268 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:56.743909 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d778227a-dafd-4896-a0ae-42d943fd670f req-318e44c4-1d1a-4d12-a408-783214744268 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0515602 Nov 24 16:23:56.798487 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-d778227a-dafd-4896-a0ae-42d943fd670f req-d0fc34d2-86ad-49a4-81aa-878060afad9e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/security-groups?id=29924edd-f685-4f6c-9337-1574bd96245f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486808 Nov 24 16:23:57.194743 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-77b5ed89-57e7-437d-a756-74ce65dbbf22 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:57.196160 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-77b5ed89-57e7-437d-a756-74ce65dbbf22 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.71 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 946 time: 0.0472703 Nov 24 16:23:57.283270 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Deleting port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:23:57.283604 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.383819 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] For port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:57.384173 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.396096 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling delete_port for 3762c609-4d3f-4e0f-a146-c0077e3c9f5c owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:23:57.521211 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.548159 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event deleted for resources: {'Port': ['ID=3762c609-4d3f-4e0f-a146-c0077e3c9f5c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:57.589896 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] No DVR routers for this DVR port 3762c609-4d3f-4e0f-a146-c0077e3c9f5c on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:23:57.592471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.595995 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-71402d15-ff23-4d51-b6eb-ddaa45c781fd req-a51bb11a-f500-43ef-a490-3e74e4b8b53e tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.71 "DELETE /v2.0/ports/3762c609-4d3f-4e0f-a146-c0077e3c9f5c HTTP/1.1" status: 204 len: 173 time: 0.3933482 Nov 24 16:23:57.596449 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-deleted', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:57.599173 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c987d06d-9123-4d68-99fe-b97058907329" -d '{"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-deleted", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:57.637609 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ccd46cd-1c2b-4535-928a-b05911510557 x-openstack-request-id: req-8ccd46cd-1c2b-4535-928a-b05911510557 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:57.637931 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-deleted", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:57.638188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-8ccd46cd-1c2b-4535-928a-b05911510557 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:57.638593 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47ed20e5-f963-4489-aa73-4d9e4306db2b', 'name': 'network-vif-deleted', 'tag': '3762c609-4d3f-4e0f-a146-c0077e3c9f5c', 'status': 'completed', 'code': 200} Nov 24 16:23:57.899110 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-dbfc6394-8e6c-4c95-a081-c085d463ac06 req-d68dc5a7-1ae3-4cda-8265-d9468926f399 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /v2.0/ports?device_id=47ed20e5-f963-4489-aa73-4d9e4306db2b HTTP/1.1" status: 200 len: 210 time: 0.0333104 Nov 24 16:23:58.957361 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42450) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:59.012701 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.038395 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.097123 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.100408 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.101547 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "DELETE /v2.0/security-groups/29924edd-f685-4f6c-9337-1574bd96245f HTTP/1.1" status: 204 len: 168 time: 0.1425984 Nov 24 16:23:59.110801 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=29924edd-f685-4f6c-9337-1574bd96245f,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:59.118678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.119022 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.119362 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.119696 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.120026 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.120354 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.120678 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.121000 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.121349 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.121670 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.121992 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.122307 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abcdfb2f-1b5b-4d0e-a756-dd564ff005f7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102787) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:59.155152 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42454) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:59.583956 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.823828 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Deleting port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:23:59.824167 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.908808 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] For port 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:59.909098 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.921388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Calling delete_port for 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c owned by network:router_interface {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:00.096887 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:00.124413 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Pushing event deleted for resources: {'Port': ['ID=5bb1a2e0-3ca6-436b-b3eb-f131740dad8c,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:00.289881 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:00.400654 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:00.423452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 3762c609-4d3f-4e0f-a146-c0077e3c9f5c {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:00.423798 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 3762c609-4d3f-4e0f-a146-c0077e3c9f5c not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:00.499769 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Router 1f3aee64-2d5d-4b44-a102-e57424d0c018 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:00.601188 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:00.606353 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-4c13209c-d839-42ea-b38f-b3762bcdead3 admin admin] 10.222.0.72 "PUT /v2.0/routers/1f3aee64-2d5d-4b44-a102-e57424d0c018/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4501324 Nov 24 16:24:00.608764 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42458) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:00.611320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Sync routers for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:00.622133 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:00.622770 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:00.710513 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks [] for router, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:00.728349 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:00.909010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:24:00Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:00.935409 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Checking router: 1f3aee64-2d5d-4b44-a102-e57424d0c018 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:00.944568 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Routers {'1f3aee64-2d5d-4b44-a102-e57424d0c018'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:00.945350 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['1f3aee64-2d5d-4b44-a102-e57424d0c018'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:01.048663 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.050332 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] Set router 1f3aee64-2d5d-4b44-a102-e57424d0c018 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:01.099733 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Deleting port 5a738596-fe07-43db-a302-240d15d3f089 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:01.100351 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.178874 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] For port 5a738596-fe07-43db-a302-240d15d3f089, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=5a738596-fe07-43db-a302-240d15d3f089,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:01.179259 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.191723 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Calling delete_port for 5a738596-fe07-43db-a302-240d15d3f089 owned by network:router_gateway {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:01.229919 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:24:00Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:01.255910 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be7a2e8d-6922-4c02-88ab-ba9a4e8272ab None None] The sync data for ids ['1f3aee64-2d5d-4b44-a102-e57424d0c018'] in dv-cinder-818994-2-iscsi is: [{'id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'name': 'tempest-TestShelveInstance-254194393-router', 'tenant_id': '0e05ec47caaa4b86ba407fd376f503c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161'}], 'enable_snat': True}, 'gw_port_id': '5a738596-fe07-43db-a302-240d15d3f089', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:24:00Z', 'revision_number': 5, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'gw_port': {'id': '5a738596-fe07-43db-a302-240d15d3f089', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:42:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f3aee64-2d5d-4b44-a102-e57424d0c018', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:45Z', 'updated_at': '2021-11-24T16:18:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:01.355432 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.384139 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Pushing event deleted for resources: {'Port': ['ID=5a738596-fe07-43db-a302-240d15d3f089,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:01.443474 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.530462 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.532566 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.574205 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.574661 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1f3aee64-2d5d-4b44-a102-e57424d0c018 {{(pid=102787) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:24:01.578973 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.580138 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6db16daf-247a-42c9-a227-fd09cf92e3d0 admin admin] 10.222.0.72 "DELETE /v2.0/routers/1f3aee64-2d5d-4b44-a102-e57424d0c018 HTTP/1.1" status: 204 len: 168 time: 0.9704351 Nov 24 16:24:01.583345 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42460) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:01.634642 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Deleting subnet 9fe1060b-8118-4779-9a4d-1c167ac19e40 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:24:01.638176 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.675562 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.742800 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:01.764204 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.765856 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:01.766213 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5bb1a2e0-3ca6-436b-b3eb-f131740dad8c not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:01.815768 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.845894 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9fe1060b-8118-4779-9a4d-1c167ac19e40,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:01.847823 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.851115 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-372263bb-fc67-4a6d-9ad2-7025f07751ff admin admin] 10.222.0.72 "DELETE /v2.0/subnets/9fe1060b-8118-4779-9a4d-1c167ac19e40 HTTP/1.1" status: 204 len: 168 time: 0.2667050 Nov 24 16:24:01.851976 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ab30b00-4f83-43f7-ab6b-e847ce0be87f None None] Network 7adfa203-bbb1-4530-a8be-f1ebfa6654ca requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:01.853711 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42462) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:01.929182 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.984583 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Deleting port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:01.984934 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.045222 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] DHCP port deletion for 7adfa203-bbb1-4530-a8be-f1ebfa6654ca request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:24:02.057264 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] For port c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:02.057635 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.070751 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Calling delete_port for c0e21560-1d84-4518-a5d3-93ea08ceb2a2 owned by network:dhcp {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:02.092461 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Deleting port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 {{(pid=102789) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:02.092838 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.149014 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.158160 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] For port c0e21560-1d84-4518-a5d3-93ea08ceb2a2, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,segment=NetworkSegment(456a71c0-a4d3-41a5-a40f-101b1f134ec0),segment_id=456a71c0-a4d3-41a5-a40f-101b1f134ec0)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:02.158587 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.179940 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Pushing event deleted for resources: {'Port': ['ID=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:02.180962 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Calling delete_port for c0e21560-1d84-4518-a5d3-93ea08ceb2a2 owned by network:dhcp {{(pid=102789) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:02.184388 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] No DVR routers for this DVR port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 on host dv-cinder-818994-2-iscsi {{(pid=102787) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:02.253499 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.258342 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.273804 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7adfa203-bbb1-4530-a8be-f1ebfa6654ca']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:02.282539 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '456a71c0-a4d3-41a5-a40f-101b1f134ec0') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:02.282833 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '456a71c0-a4d3-41a5-a40f-101b1f134ec0') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:02.283117 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Pushing event deleted for resources: {'Port': ['ID=c0e21560-1d84-4518-a5d3-93ea08ceb2a2,revision_number=None']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:02.290946 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] No DVR routers for this DVR port c0e21560-1d84-4518-a5d3-93ea08ceb2a2 on host dv-cinder-818994-2-iscsi {{(pid=102789) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:02.292838 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.293217 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.293349 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.293566 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.293908 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.294245 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.294581 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.294911 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.295242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.295571 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.295899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.296223 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.296547 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9338d54-5572-448c-9283-ce9ea0ecd8d4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818994-2-iscsi {{(pid=102789) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:02.307020 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.313337 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Releasing vlan 1048 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:24:02.313729 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:24:02.315405 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:24:02.373107 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.378743 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.383150 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] 10.222.0.72 "DELETE /v2.0/networks/7adfa203-bbb1-4530-a8be-f1ebfa6654ca HTTP/1.1" status: 204 len: 168 time: 0.5281169 Nov 24 16:24:02.386156 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42464) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:02.394454 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a85225-124f-4f87-adb0-173f222763aa admin admin] Pushing event deleted for resources: {'Network': ['ID=7adfa203-bbb1-4530-a8be-f1ebfa6654ca,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:02.728779 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.962042 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Deleting port 26fb9dba-1538-4672-8935-c93d6cecaaf0 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:02.962373 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.035033 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] For port 26fb9dba-1538-4672-8935-c93d6cecaaf0, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=26fb9dba-1538-4672-8935-c93d6cecaaf0,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:03.035307 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.047444 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Calling delete_port for 26fb9dba-1538-4672-8935-c93d6cecaaf0 owned by network:router_interface {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:03.216824 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.245167 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Pushing event deleted for resources: {'Port': ['ID=26fb9dba-1538-4672-8935-c93d6cecaaf0,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:03.404993 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.607162 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Router 4c19c2ef-4762-4c81-812a-5573ff4097d3 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:03.713194 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:03.718171 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-9fed31af-0c4d-4a5d-967f-a14deb9f26ec admin admin] 10.222.0.72 "PUT /v2.0/routers/4c19c2ef-4762-4c81-812a-5573ff4097d3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3309240 Nov 24 16:24:03.720635 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42466) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:03.725079 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Sync routers for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:03.730875 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c0e21560-1d84-4518-a5d3-93ea08ceb2a2 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:03.735737 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:03.735737 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:03.754255 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: c0e21560-1d84-4518-a5d3-93ea08ceb2a2 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:03.755314 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c0e21560-1d84-4518-a5d3-93ea08ceb2a2 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:03.755749 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5a738596-fe07-43db-a302-240d15d3f089 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:03.776731 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 5a738596-fe07-43db-a302-240d15d3f089 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:03.777087 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 5a738596-fe07-43db-a302-240d15d3f089 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:03.824358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks [] for router, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.846177 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:03.922884 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.980067 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Deleting port 82980381-12d7-40f4-85fb-9f92c3734df5 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:03.980407 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.023891 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:24:03Z', 'revision_number': 5, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port': {'id': '82980381-12d7-40f4-85fb-9f92c3734df5', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:aa:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:18:50Z', 'updated_at': '2021-11-24T16:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:04.053745 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Checking router: 4c19c2ef-4762-4c81-812a-5573ff4097d3 for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:04.057327 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] For port 82980381-12d7-40f4-85fb-9f92c3734df5, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=82980381-12d7-40f4-85fb-9f92c3734df5,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:04.057693 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.061875 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Routers {'4c19c2ef-4762-4c81-812a-5573ff4097d3'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:04.062475 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:23:51Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['4c19c2ef-4762-4c81-812a-5573ff4097d3'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:04.069744 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Calling delete_port for 82980381-12d7-40f4-85fb-9f92c3734df5 owned by network:router_gateway {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:04.232514 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.236487 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] Set router 4c19c2ef-4762-4c81-812a-5573ff4097d3 gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:04.265324 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Pushing event deleted for resources: {'Port': ['ID=82980381-12d7-40f4-85fb-9f92c3734df5,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:04.291426 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:24:03Z', 'revision_number': 6, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:04.317586 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.323050 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa6f67-e451-47df-a563-30cdcfe00a5f None None] The sync data for ids ['4c19c2ef-4762-4c81-812a-5573ff4097d3'] in dv-cinder-818994-2-iscsi is: [{'id': '4c19c2ef-4762-4c81-812a-5573ff4097d3', 'name': 'tempest-TestShelveInstance-167906658-router', 'tenant_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:18:49Z', 'updated_at': '2021-11-24T16:24:03Z', 'revision_number': 6, 'project_id': 'adb5033fc32a4c91a257ffffa45b41c6', 'gw_port_host': None}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:04.406111 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.408188 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.450971 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.451475 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4c19c2ef-4762-4c81-812a-5573ff4097d3 {{(pid=102788) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:24:04.455659 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.456789 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a4897243-89d5-47af-bc2d-47d63433db77 admin admin] 10.222.0.72 "DELETE /v2.0/routers/4c19c2ef-4762-4c81-812a-5573ff4097d3 HTTP/1.1" status: 204 len: 168 time: 0.7351482 Nov 24 16:24:04.459655 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42468) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:04.507358 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.db_base_plugin_v2 [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Deleting subnet c13625a3-6727-4af5-969f-5fccba782446 {{(pid=102788) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:24:04.510325 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.543368 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30444690'] for subnet, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.616431 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.668817 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29518436', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29486226'] for subnet, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.698509 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c13625a3-6727-4af5-969f-5fccba782446,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:04.702489 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for subnet, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.708521 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-27f1977e-22b9-44ef-882a-aa270c3cd918 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/c13625a3-6727-4af5-969f-5fccba782446 HTTP/1.1" status: 204 len: 168 time: 0.2451780 Nov 24 16:24:04.709381 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42470) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:04.713166 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f3b5f8c-123c-490d-b095-479766fd1377 None None] Network 71de30af-668e-4bd8-a00b-993a1a013f86 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:04.780304 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.834177 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Deleting port 1f267ff1-80bb-422b-9189-0cb444f5d1eb {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:04.834520 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.899441 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] For port 1f267ff1-80bb-422b-9189-0cb444f5d1eb, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=1f267ff1-80bb-422b-9189-0cb444f5d1eb,segment=NetworkSegment(654244e8-cc72-4b31-be6c-c131be2ed667),segment_id=654244e8-cc72-4b31-be6c-c131be2ed667)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:04.899801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:04.911615 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Calling delete_port for 1f267ff1-80bb-422b-9189-0cb444f5d1eb owned by network:dhcp {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:04.985349 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.109282 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-611440f2-67ac-4516-aad2-e1235334b2c1 None None] DHCP port deletion for 71de30af-668e-4bd8-a00b-993a1a013f86 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:24:05.263751 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Pushing event deleted for resources: {'Port': ['ID=1f267ff1-80bb-422b-9189-0cb444f5d1eb,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:05.267134 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] No DVR routers for this DVR port 1f267ff1-80bb-422b-9189-0cb444f5d1eb on host dv-cinder-818994-2-iscsi {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:05.337438 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.358006 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71de30af-668e-4bd8-a00b-993a1a013f86']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:05.368409 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '654244e8-cc72-4b31-be6c-c131be2ed667') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:05.368705 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '654244e8-cc72-4b31-be6c-c131be2ed667') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:05.381834 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.395195 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.401546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Releasing vlan 1042 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:24:05.401940 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:24:05.403591 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:24:05.458463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.463846 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.467063 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] 10.222.0.72 "DELETE /v2.0/networks/71de30af-668e-4bd8-a00b-993a1a013f86 HTTP/1.1" status: 204 len: 168 time: 0.7573717 Nov 24 16:24:05.478121 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc0ea5d-a5a7-4507-8c06-3e5b8f4f404e admin admin] Pushing event deleted for resources: {'Network': ['ID=71de30af-668e-4bd8-a00b-993a1a013f86,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:05.574854 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42474) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:05.614233 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-c2758401-171f-4e57-934e-b772d5dfecc2 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0e05ec47caaa4b86ba407fd376f503c6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0380442 Nov 24 16:24:05.616499 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42476) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:05.664758 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.684242 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1f267ff1-80bb-422b-9189-0cb444f5d1eb no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:05.685667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.703544 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 1f267ff1-80bb-422b-9189-0cb444f5d1eb {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:05.703972 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 1f267ff1-80bb-422b-9189-0cb444f5d1eb not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:05.704484 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 26fb9dba-1538-4672-8935-c93d6cecaaf0 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:05.726516 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 26fb9dba-1538-4672-8935-c93d6cecaaf0 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:05.726727 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 26fb9dba-1538-4672-8935-c93d6cecaaf0 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:05.727123 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 82980381-12d7-40f4-85fb-9f92c3734df5 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:05.739867 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.742646 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:05.743823 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c3069819-a409-490d-88ab-ef875d0837ab HTTP/1.1" status: 204 len: 168 time: 0.1263876 Nov 24 16:24:05.747315 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 82980381-12d7-40f4-85fb-9f92c3734df5 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:05.747667 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 82980381-12d7-40f4-85fb-9f92c3734df5 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:05.755991 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47d69484-6aa3-412c-a30a-7997af79c971 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3069819-a409-490d-88ab-ef875d0837ab,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:06.051102 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42482) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:06.090391 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-2ac1432b-b616-496c-9029-8c0d76acab29 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=adb5033fc32a4c91a257ffffa45b41c6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0380695 Nov 24 16:24:06.092624 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42484) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:06.138290 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.158323 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.210512 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.213690 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.214410 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/55115b91-d828-441b-bfcb-cbdcdc468abf HTTP/1.1" status: 204 len: 168 time: 0.1208849 Nov 24 16:24:06.222518 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c17f783-bc10-4ede-92fa-605bb6ca2544 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55115b91-d828-441b-bfcb-cbdcdc468abf,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:14.444900 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.651487 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-ae78d887-2d68-42de-9155-9b9a9992ae2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.305419 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bbdb66f2-6c88-4331-9e8e-48b6fee56dbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:22.713752 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:24.393323 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:24.530274 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:24.992623 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:24:29.919447 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42488) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:30.072483 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port 9f7779ce-7633-4762-914a-f7957325580b {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:30.072826 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.145895 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.146219 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.157647 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for 9f7779ce-7633-4762-914a-f7957325580b owned by network:floatingip {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:30.326554 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.356282 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=9f7779ce-7633-4762-914a-f7957325580b,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:30.422298 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.422635 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.db.l3_db [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 8d47c460-8c8f-4f48-b41a-f524fd4037c5 disassociated (deleted). External IP: 172.27.0.90, port: 5fb88ff0-bd58-4f17-b36d-7ceece933b04. Nov 24 16:24:30.625872 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:30.730174 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:30.735129 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.739934 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:30.749236 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:30.749844 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:30.762137 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-f6c4b951-c0d1-43d1-9aa4-962a36ff7fd5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /v2.0/floatingips/8d47c460-8c8f-4f48-b41a-f524fd4037c5 HTTP/1.1" status: 204 len: 168 time: 0.8416193 Nov 24 16:24:30.762723 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04'}] {{(pid=102787) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:24:30.764979 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21e59431c17d0488de851f53b1f94dcb28a03704d3b1c6e37242f46b99267d8e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2" -d '{"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]}' {{(pid=102787) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:24:30.807144 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:24:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f337be6-ad86-455e-a7dc-4da9764d06af x-openstack-request-id: req-4f337be6-ad86-455e-a7dc-4da9764d06af {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:24:30.807580 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04", "status": "completed", "code": 200}]} {{(pid=102787) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:24:30.808351 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-4f337be6-ad86-455e-a7dc-4da9764d06af {{(pid=102787) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:24:30.808790 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'status': 'completed', 'code': 200} Nov 24 16:24:30.872938 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:30.873516 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-7949fdf4-f9f0-497a-9ecb-d216d8c7af8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:30.875145 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-7949fdf4-f9f0-497a-9ecb-d216d8c7af8f service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 1099 time: 0.0444787 Nov 24 16:24:30.998199 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-903cb83d-c44d-48ed-a807-1914e0ef446d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:30.999664 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-903cb83d-c44d-48ed-a807-1914e0ef446d service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.1145926 Nov 24 16:24:31.014555 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a105efcc-96b9-45b6-8426-4107eaee323a req-c389636c-95f3-459e-a5c5-76da229a7f9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:31.015967 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a105efcc-96b9-45b6-8426-4107eaee323a req-c389636c-95f3-459e-a5c5-76da229a7f9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0729642 Nov 24 16:24:31.056364 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-d56eef95-4246-4887-9e19-6731acd74d9b service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 200 len: 217 time: 0.0394638 Nov 24 16:24:31.105051 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:31.124895 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a105efcc-96b9-45b6-8426-4107eaee323a req-9e89890f-2fb0-4fc4-aad2-496f7ae4e803 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1009958 Nov 24 16:24:31.129598 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-96fa44e8-80ea-44c1-b860-b39008cd9ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:31.131131 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-96fa44e8-80ea-44c1-b860-b39008cd9ecb service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0672569 Nov 24 16:24:31.132286 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:31.140857 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:31.141443 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:31.182737 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-133a2b35-bfa2-48c2-b94c-6a9e1658463a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:31.184294 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-133a2b35-bfa2-48c2-b94c-6a9e1658463a service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0454063 Nov 24 16:24:31.278803 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-b461a03d-e7bb-4c13-923b-6f4f11cd5ccc service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858970 Nov 24 16:24:31.376148 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:31.376386 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-aff11299-3fe9-42d6-a179-603d9b55bf4c service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887489 Nov 24 16:24:31.596131 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:31.621104 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a60dd70c-b706-4163-8493-c0349425c23c None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_floatingips': [{'id': '0c779274-dadf-4aa6-89b9-4f51ac27e896', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'floating_ip_address': '172.27.0.203', 'floating_network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'router_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'port_id': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'mac_address': 'fa:16:3e:6f:dd:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:20:06Z', 'updated_at': '2021-11-24T16:20:08Z', 'revision_number': 1, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:31.830646 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e4e38a3-2a40-4a24-822b-abae1aa8ffcd None None] New status for floating IP 8d47c460-8c8f-4f48-b41a-f524fd4037c5: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:24:32.249307 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 req-937e6a8f-ee04-4b5f-ab55-365fc68b0307 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:32.251097 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 req-937e6a8f-ee04-4b5f-ab55-365fc68b0307 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0495214 Nov 24 16:24:32.302944 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 req-e3159543-a70a-49f3-b516-54425e441c1a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459034 Nov 24 16:24:32.711318 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-c94b94d6-f8f0-4936-9dbd-d74b98215878 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:32.712753 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-c94b94d6-f8f0-4936-9dbd-d74b98215878 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 946 time: 0.0470843 Nov 24 16:24:32.802132 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:32.802471 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:32.888180 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] For port 5fb88ff0-bd58-4f17-b36d-7ceece933b04, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=5fb88ff0-bd58-4f17-b36d-7ceece933b04,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:32.888546 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:32.901148 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for 5fb88ff0-bd58-4f17-b36d-7ceece933b04 owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:33.025163 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.052174 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=5fb88ff0-bd58-4f17-b36d-7ceece933b04,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:33.103158 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] No DVR routers for this DVR port 5fb88ff0-bd58-4f17-b36d-7ceece933b04 on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:33.106114 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.109477 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-85989b44-93c5-42a3-aed5-dbe081dba5a6 req-74430f0b-22e4-4eb4-ac2b-8bc67aff2eec tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "DELETE /v2.0/ports/5fb88ff0-bd58-4f17-b36d-7ceece933b04 HTTP/1.1" status: 204 len: 173 time: 0.3908045 Nov 24 16:24:33.109921 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'name': 'network-vif-deleted', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:24:33.112157 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854" -d '{"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-deleted", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:24:33.158472 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:24:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ba72517-27ad-4138-bab4-3a3137096b42 x-openstack-request-id: req-7ba72517-27ad-4138-bab4-3a3137096b42 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:24:33.158801 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-deleted", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:24:33.159069 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-7ba72517-27ad-4138-bab4-3a3137096b42 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:24:33.159481 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5d37abd-923b-419b-805e-303baf82ea67', 'name': 'network-vif-deleted', 'tag': '5fb88ff0-bd58-4f17-b36d-7ceece933b04', 'status': 'completed', 'code': 200} Nov 24 16:24:33.404408 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-60266111-a67e-449a-8899-273e3c861bd0 req-1c2d5363-579b-4067-9397-2df4138f47b0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=e5d37abd-923b-419b-805e-303baf82ea67 HTTP/1.1" status: 200 len: 210 time: 0.0353711 Nov 24 16:24:34.460191 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-fc744ccf-0e5f-4534-993e-865c2bbbae41 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0403395 Nov 24 16:24:34.552753 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-917be614-10b7-4c90-8832-e0dd719cee14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.554432 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-917be614-10b7-4c90-8832-e0dd719cee14 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0539391 Nov 24 16:24:34.659223 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-6e0a789e-74f0-4c99-b8fa-4929677a5d2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.661269 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-6e0a789e-74f0-4c99-b8fa-4929677a5d2c service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.0880935 Nov 24 16:24:34.729478 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-d33d7781-36de-4506-81ab-e27b467d4537 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 1002 time: 0.0607421 Nov 24 16:24:34.777558 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-9b55cc74-2b5e-4891-bf7e-5f07b0a308f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.778975 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-9b55cc74-2b5e-4891-bf7e-5f07b0a308f3 service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0432673 Nov 24 16:24:34.828232 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-4e15c5a9-a966-4ee5-81a9-9b719eb25850 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.829747 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-4e15c5a9-a966-4ee5-81a9-9b719eb25850 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435669 Nov 24 16:24:34.918086 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-e8a4c80a-6534-4440-a548-b71029937164 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810280 Nov 24 16:24:35.007868 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-789d3e68-a35c-4f0e-98f4-468de98c2a95 req-015953ce-c83b-49b4-ab2a-9a71590ba264 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820637 Nov 24 16:24:36.540461 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 5fb88ff0-bd58-4f17-b36d-7ceece933b04 no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:36.560199 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: 5fb88ff0-bd58-4f17-b36d-7ceece933b04 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:36.560544 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device 5fb88ff0-bd58-4f17-b36d-7ceece933b04 not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:36.680877 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42518) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:36.832458 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port 897ca4b0-b7c0-4253-9ef3-c2c796552112 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:36.832688 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.905429 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.905760 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.917768 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for 897ca4b0-b7c0-4253-9ef3-c2c796552112 owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:37.061391 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.088425 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=897ca4b0-b7c0-4253-9ef3-c2c796552112,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:37.146355 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.146681 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.db.l3_db [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Floating IP 0c779274-dadf-4aa6-89b9-4f51ac27e896 disassociated (deleted). External IP: 172.27.0.203, port: f28496a8-b616-467e-a96a-64cd302d5c4e. Nov 24 16:24:37.348869 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:37.453777 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:37.458782 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.464813 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:37.474775 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:37.475386 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:37.484122 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-8b939019-ada3-4d47-aa2a-24c44c673833 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /v2.0/floatingips/0c779274-dadf-4aa6-89b9-4f51ac27e896 HTTP/1.1" status: 204 len: 168 time: 0.8021333 Nov 24 16:24:37.484819 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:24:37.487334 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a10b3ff7-1738-47ec-bceb-65fc1070ba68" -d '{"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:24:37.526038 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:24:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 x-openstack-request-id: req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:24:37.526328 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:24:37.526585 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:24:37.527021 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'status': 'completed', 'code': 200} Nov 24 16:24:37.589443 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-42008596-bcd1-49cf-9027-d0ae97b32f41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.591268 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-42008596-bcd1-49cf-9027-d0ae97b32f41 service neutron] 10.222.0.71 "GET /v2.0/ports?tenant_id=7ae2d50102bf491986834edf07a6a868&device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 1099 time: 0.0430291 Nov 24 16:24:37.602037 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:37.727287 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-6c4010da-edaf-4067-aba3-cf918024272f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.728763 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-6c4010da-edaf-4067-aba3-cf918024272f service neutron] 10.222.0.71 "GET /v2.0/networks?id=e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 200 len: 914 time: 0.1306438 Nov 24 16:24:37.744999 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 req-60d5ec44-f6cf-4a83-9289-784f135c29b6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.746476 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 req-60d5ec44-f6cf-4a83-9289-784f135c29b6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0633838 Nov 24 16:24:37.787034 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-9d2c7517-9803-4b10-8200-1a350250b535 service neutron] 10.222.0.71 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 200 len: 217 time: 0.0396173 Nov 24 16:24:37.810622 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:37.837067 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:37.845415 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:37.846032 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:37.860679 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 req-f2f89030-e52d-493d-8e64-b2a75a91ce2b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1052549 Nov 24 16:24:37.864965 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-e11bcffc-588e-4a0e-b83c-97dd932d641d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.866399 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-e11bcffc-588e-4a0e-b83c-97dd932d641d service neutron] 10.222.0.71 "GET /v2.0/subnets?id=d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 200 len: 851 time: 0.0712650 Nov 24 16:24:37.915687 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-73820a6f-d1c8-40e9-95d6-a1b1bfa7b419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.917216 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-73820a6f-d1c8-40e9-95d6-a1b1bfa7b419 service neutron] 10.222.0.71 "GET /v2.0/ports?network_id=e94d2a4c-106b-44d2-b8a7-a2440253d60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394793 Nov 24 16:24:37.957782 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:38.010143 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-a69531a9-eed3-4a3e-a331-cce22ca94614 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833488 Nov 24 16:24:38.102731 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-d2d25e79-b597-44f6-aedf-6d01e83b62f1 service neutron] 10.222.0.71 "GET /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841179 Nov 24 16:24:38.162170 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:38.196968 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7033298-e440-49d8-b3ca-60f6f6979631 None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:16:07Z', 'revision_number': 4, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi', '_interfaces': [{'id': 'c8d53c1a-5321-4c74-a7d2-701ca6324a4a', 'name': '', 'network_id': 'e94d2a4c-106b-44d2-b8a7-a2440253d60c', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'mac_address': 'fa:16:3e:27:9f:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': 'd3f57000-e20c-491a-8f21-32857a544343', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:06Z', 'updated_at': '2021-11-24T16:16:12Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'subnets': [{'id': 'd3f57000-e20c-491a-8f21-32857a544343', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:38.394853 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-066fc97c-b0a1-44f5-a15f-147ac2f02553 None None] New status for floating IP 0c779274-dadf-4aa6-89b9-4f51ac27e896: DOWN {{(pid=102790) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:24:38.978704 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 req-21ca7961-6a89-4cf5-b322-f76a99443ff5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102787) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:38.980156 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 req-21ca7961-6a89-4cf5-b322-f76a99443ff5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0495722 Nov 24 16:24:39.029337 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 req-cf801845-7cef-4441-b5f4-2b1838671238 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/security-groups?id=2d157481-120f-42c9-be9e-2b8cef9b61c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432370 Nov 24 16:24:39.417359 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-8ff0e91c-043c-4841-a3f7-469ee27f3d3c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102788) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:39.418790 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-8ff0e91c-043c-4841-a3f7-469ee27f3d3c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 946 time: 0.0500634 Nov 24 16:24:39.509869 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port f28496a8-b616-467e-a96a-64cd302d5c4e {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:39.510110 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.598392 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] For port f28496a8-b616-467e-a96a-64cd302d5c4e, host hv-cinder-81899, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81899',level=0,port_id=f28496a8-b616-467e-a96a-64cd302d5c4e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:39.598750 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.610041 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for f28496a8-b616-467e-a96a-64cd302d5c4e owned by compute:nova {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:39.734595 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.766748 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=f28496a8-b616-467e-a96a-64cd302d5c4e,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:39.811168 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] No DVR routers for this DVR port f28496a8-b616-467e-a96a-64cd302d5c4e on host hv-cinder-81899 {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:39.813628 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for port, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.817672 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [req-c1a92d78-ee0a-450b-925c-a821d8951ead req-635c31ad-2f6b-417c-bb1b-59c6a5be9b8e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.71 "DELETE /v2.0/ports/f28496a8-b616-467e-a96a-64cd302d5c4e HTTP/1.1" status: 204 len: 173 time: 0.3921041 Nov 24 16:24:39.818118 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'name': 'network-vif-deleted', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e'}] {{(pid=102788) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:24:39.820378 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.72/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e21a35899e540c45541ffdcc180017ea6c084d1923fb6454b52965b20f3eb85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-413d3eb6-c304-41a3-a190-a91b0fb30032" -d '{"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-deleted", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]}' {{(pid=102788) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:24:39.859829 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:24:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 x-openstack-request-id: req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:24:39.860168 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-deleted", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e", "status": "completed", "code": 200}]} {{(pid=102788) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:24:39.860399 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.72/compute/v2.1/os-server-external-events used request id req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 {{(pid=102788) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:24:39.860799 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '010bad81-4c64-4106-8ff5-ba171e3352ff', 'name': 'network-vif-deleted', 'tag': 'f28496a8-b616-467e-a96a-64cd302d5c4e', 'status': 'completed', 'code': 200} Nov 24 16:24:40.141225 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [req-14c5596b-f804-4f93-86ab-da9a58e7e80e req-2314a9dd-1ca3-40a0-abfe-f128d2812f69 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /v2.0/ports?device_id=010bad81-4c64-4106-8ff5-ba171e3352ff HTTP/1.1" status: 200 len: 210 time: 0.0301621 Nov 24 16:24:41.197667 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42534) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:41.316942 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Deleting port e949b91c-7257-4852-9eff-eb9691661eaf {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:41.317310 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.391706 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.392032 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.403296 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling delete_port for e949b91c-7257-4852-9eff-eb9691661eaf owned by network:floatingip {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:41.528836 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.801828 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'Port': ['ID=e949b91c-7257-4852-9eff-eb9691661eaf,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:41.859015 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for floatingip, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.861608 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234591'] for floatingip, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.863344 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-ecbc550c-e0a7-440c-aded-ce2726a8f357 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /v2.0/floatingips/824de0e5-547d-422f-ba1f-5a10d2a418b6 HTTP/1.1" status: 204 len: 168 time: 0.6640868 Nov 24 16:24:42.571206 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f28496a8-b616-467e-a96a-64cd302d5c4e no longer exists at agent hyperv_hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:42.591555 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] No Port match for: f28496a8-b616-467e-a96a-64cd302d5c4e {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:42.591903 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Device f28496a8-b616-467e-a96a-64cd302d5c4e not bound to the agent host hv-cinder-81899 {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:43.054720 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42546) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:43.108346 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.137274 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.194528 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.197290 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.198405 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /v2.0/security-groups/2d157481-120f-42c9-be9e-2b8cef9b61c9 HTTP/1.1" status: 204 len: 168 time: 0.1426933 Nov 24 16:24:43.207482 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a79f2c9-58ee-4497-9198-a01253b9a3f0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d157481-120f-42c9-be9e-2b8cef9b61c9,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:43.258157 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42550) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:43.786936 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.028042 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Deleting port c8d53c1a-5321-4c74-a7d2-701ca6324a4a {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:44.028375 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.103245 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] For port c8d53c1a-5321-4c74-a7d2-701ca6324a4a, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:44.103605 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.116236 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Calling delete_port for c8d53c1a-5321-4c74-a7d2-701ca6324a4a owned by network:router_interface {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:44.306663 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.330607 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Pushing event deleted for resources: {'Port': ['ID=c8d53c1a-5321-4c74-a7d2-701ca6324a4a,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:44.460973 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.495848 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.701561 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102788) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:44.803514 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102788) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:44.808514 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-4bacc838-4ccf-4733-bdcb-c8532d378ad5 admin admin] 10.222.0.72 "PUT /v2.0/routers/eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5492551 Nov 24 16:24:44.810909 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42554) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:44.814356 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Sync routers for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:44.827836 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:44.828434 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:44.918969 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks [] for router, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.936038 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: dv-cinder-818994-2-iscsi {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:45.015583 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.070877 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Deleting port 59d65189-e006-4b9c-8a20-8e5ec7f687a6 {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:45.071204 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.109379 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103'}], 'enable_snat': True}, 'gw_port_id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:24:44Z', 'revision_number': 5, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port': {'id': '59d65189-e006-4b9c-8a20-8e5ec7f687a6', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:38:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:05Z', 'updated_at': '2021-11-24T16:16:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:45.135703 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Checking router: eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 for host: dv-cinder-818994-2-iscsi {{(pid=102789) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:45.144111 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Routers {'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102789) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:45.144747 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'], 'active': True} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:45.146988 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] For port 59d65189-e006-4b9c-8a20-8e5ec7f687a6, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=59d65189-e006-4b9c-8a20-8e5ec7f687a6,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:45.147463 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.160467 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Calling delete_port for 59d65189-e006-4b9c-8a20-8e5ec7f687a6 owned by network:router_gateway {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:45.230788 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvr_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] Set router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 gateway port host: None {{(pid=102789) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:45.286026 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_hamode_db [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:24:45Z', 'revision_number': 6, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102789) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:45.310984 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bb5b7c-0294-4586-8f70-feb4bd9cb2ca None None] The sync data for ids ['eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9'] in dv-cinder-818994-2-iscsi is: [{'id': 'eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9', 'name': 'tempest-TestVolumeBootPattern-1378381455-router', 'tenant_id': '7ae2d50102bf491986834edf07a6a868', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:04Z', 'updated_at': '2021-11-24T16:24:45Z', 'revision_number': 6, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'gw_port_host': None}] {{(pid=102789) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:45.325862 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.357901 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Pushing event deleted for resources: {'Port': ['ID=59d65189-e006-4b9c-8a20-8e5ec7f687a6,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:45.416080 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.502765 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.506207 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.547401 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.547984 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 {{(pid=102788) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:24:45.553831 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] Publish callbacks [] for router, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.555010 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-a18ecddc-85de-42dd-950b-351cf6b3cda8 admin admin] 10.222.0.72 "DELETE /v2.0/routers/eee6f904-0db6-4f92-8a0f-10b4a0d2e4d9 HTTP/1.1" status: 204 len: 168 time: 0.7431459 Nov 24 16:24:45.557845 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42556) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:45.602834 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Deleting subnet d3f57000-e20c-491a-8f21-32857a544343 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:24:45.605876 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.639926 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.727603 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.786892 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.810875 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d3f57000-e20c-491a-8f21-32857a544343,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:45.818250 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.821550 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-922eb256-2911-4fd1-88f3-10a2bcba7844 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/d3f57000-e20c-491a-8f21-32857a544343 HTTP/1.1" status: 204 len: 168 time: 0.2624187 Nov 24 16:24:45.823971 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f9adeb3-f5c5-49fe-9597-3b472312f645 None None] Network e94d2a4c-106b-44d2-b8a7-a2440253d60c requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:45.824497 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [-] (102788) accepted ('10.222.0.72', 42558) {{(pid=102788) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:45.895396 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.947627 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Deleting port 826a8de4-a432-4d3d-b640-55bdbafac32e {{(pid=102788) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:45.947967 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.012992 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.db [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] For port 826a8de4-a432-4d3d-b640-55bdbafac32e, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=826a8de4-a432-4d3d-b640-55bdbafac32e,segment=NetworkSegment(4f483b91-e552-422c-aad1-7b8f845efd1f),segment_id=4f483b91-e552-422c-aad1-7b8f845efd1f)] {{(pid=102788) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:46.013384 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.025836 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.plugin [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Calling delete_port for 826a8de4-a432-4d3d-b640-55bdbafac32e owned by network:dhcp {{(pid=102788) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:46.106776 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22f3c469-3613-4837-8237-e727ac1430cc None None] DHCP port deletion for e94d2a4c-106b-44d2-b8a7-a2440253d60c request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:24:46.107402 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29518393'] for port, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.112056 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c8d53c1a-5321-4c74-a7d2-701ca6324a4a no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:46.136539 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Pushing event deleted for resources: {'Port': ['ID=826a8de4-a432-4d3d-b640-55bdbafac32e,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:46.138385 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] No DVR routers for this DVR port 826a8de4-a432-4d3d-b640-55bdbafac32e on host dv-cinder-818994-2-iscsi {{(pid=102788) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:46.152695 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: c8d53c1a-5321-4c74-a7d2-701ca6324a4a {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:46.153069 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device c8d53c1a-5321-4c74-a7d2-701ca6324a4a not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:46.217507 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.240198 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e94d2a4c-106b-44d2-b8a7-a2440253d60c']}} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:46.249140 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f483b91-e552-422c-aad1-7b8f845efd1f') {'for_net_delete': True} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:46.249442 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.services.segments.db [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f483b91-e552-422c-aad1-7b8f845efd1f') {} {{(pid=102788) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:46.259365 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30444683'] for segment, before_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.273715 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.283233 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Releasing vlan 1010 on physical network physnet1 to pool {{(pid=102788) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:24:46.283837 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29518026'] for segment, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: Traceback (most recent call last): Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: timer() Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: cb(*args, **kw) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: return func(*args, **kwargs) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: self._notify() Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: self.callback(batched_events) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: event.method(event) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: return f(self, *a, **k) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._get(url).json() Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: return self.request(url, 'GET', **kwargs) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:24:46.287461 dv-cinder-818994-2-iscsi neutron-server[102788]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:24:46.346477 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.353698 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron_lib.callbacks.manager [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102788) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.357408 dv-cinder-818994-2-iscsi neutron-server[102788]: INFO neutron.wsgi [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] 10.222.0.72 "DELETE /v2.0/networks/e94d2a4c-106b-44d2-b8a7-a2440253d60c HTTP/1.1" status: 204 len: 168 time: 0.5322711 Nov 24 16:24:46.360460 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42560) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:46.368382 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8818c099-35ef-492b-8255-f89696fc1990 admin admin] Pushing event deleted for resources: {'Network': ['ID=e94d2a4c-106b-44d2-b8a7-a2440253d60c,revision_number=None']} {{(pid=102788) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:46.705117 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33087665'] for router_interface, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.940077 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Deleting port f4a3ed40-460c-400c-bbfa-2e2503120f37 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:46.940429 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:47.019476 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] For port f4a3ed40-460c-400c-bbfa-2e2503120f37, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=f4a3ed40-460c-400c-bbfa-2e2503120f37,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:47.019759 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:47.031709 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Calling delete_port for f4a3ed40-460c-400c-bbfa-2e2503120f37 owned by network:router_interface {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:47.204475 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:47.230197 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Pushing event deleted for resources: {'Port': ['ID=f4a3ed40-460c-400c-bbfa-2e2503120f37,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:47.393011 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33143349', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33089569'] for router_interface, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:47.600157 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce has already been hosted by L3 agent 2726a89c-f4c8-4e13-b79e-1f026bf4c0d3 {{(pid=102787) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:47.751739 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 826a8de4-a432-4d3d-b640-55bdbafac32e no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:47.902320 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 826a8de4-a432-4d3d-b640-55bdbafac32e {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:47.902569 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 826a8de4-a432-4d3d-b640-55bdbafac32e not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:47.902994 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 59d65189-e006-4b9c-8a20-8e5ec7f687a6 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:47.922174 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: 59d65189-e006-4b9c-8a20-8e5ec7f687a6 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:47.922523 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device 59d65189-e006-4b9c-8a20-8e5ec7f687a6 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:47.944366 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] Notify agent at l3_agent.dv-cinder-818994-2-iscsi the message routers_updated {{(pid=102787) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:47.949293 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a6316525-8c80-4bde-9499-aab327342ea2 admin admin] 10.222.0.72 "PUT /v2.0/routers/041ba8d6-e5f1-480f-ae0e-3fd162f300ce/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5875568 Nov 24 16:24:47.951795 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42562) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:47.955496 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Sync routers for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:47.965963 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:47.966639 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:48.055300 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks [] for router, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.067472 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: dv-cinder-818994-2-iscsi {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:48.156141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.209321 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Deleting port dc213cc3-7cff-4a2f-a651-e00aef4da146 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:48.209730 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.239643 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'external_fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32'}], 'enable_snat': True}, 'gw_port_id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:24:47Z', 'revision_number': 5, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port': {'id': 'dc213cc3-7cff-4a2f-a651-e00aef4da146', 'name': '', 'network_id': 'b30ec751-e8b3-4e51-a19c-98cbd4d210ff', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:cf:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 637, 'fixed_ips': [{'subnet_id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'ip_address': '172.27.0.32', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818994-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:16:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '824670b0-d537-4fe9-a92d-99c6238378a4', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818994-2-iscsi'}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:48.268219 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Checking router: 041ba8d6-e5f1-480f-ae0e-3fd162f300ce for host: dv-cinder-818994-2-iscsi {{(pid=102790) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:48.276961 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Routers {'041ba8d6-e5f1-480f-ae0e-3fd162f300ce'} bound to L3 agent in host dv-cinder-818994-2-iscsi {{(pid=102790) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:48.277638 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818994-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T15:57:21Z,description=,heartbeat_timestamp=2021-11-24T16:24:21Z,host='dv-cinder-818994-2-iscsi',id=2726a89c-f4c8-4e13-b79e-1f026bf4c0d3,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T15:57:21Z,topic='l3_agent')) {'router_ids': ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'], 'active': True} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:48.294428 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] For port dc213cc3-7cff-4a2f-a651-e00aef4da146, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=dc213cc3-7cff-4a2f-a651-e00aef4da146,segment=NetworkSegment(8cf6f0fa-902a-4107-903f-7e946fa3729f),segment_id=8cf6f0fa-902a-4107-903f-7e946fa3729f)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:48.294786 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.306488 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Calling delete_port for dc213cc3-7cff-4a2f-a651-e00aef4da146 owned by network:router_gateway {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:48.366693 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_dvr_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] Set router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce gateway port host: None {{(pid=102790) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:48.418526 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.l3_hamode_db [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:24:48Z', 'revision_number': 6, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port_host': None}], 'dv-cinder-818994-2-iscsi', False) {} {{(pid=102790) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:48.449229 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca72e4dc-2cc2-4dfa-881a-4c7011889198 None None] The sync data for ids ['041ba8d6-e5f1-480f-ae0e-3fd162f300ce'] in dv-cinder-818994-2-iscsi is: [{'id': '041ba8d6-e5f1-480f-ae0e-3fd162f300ce', 'name': 'tempest-TestVolumeBootPattern-15430155-router', 'tenant_id': 'aca002fad1b1436093645ee6f6cbd831', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:16:09Z', 'updated_at': '2021-11-24T16:24:48Z', 'revision_number': 6, 'project_id': 'aca002fad1b1436093645ee6f6cbd831', 'gw_port_host': None}] {{(pid=102790) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:48.496097 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.524016 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Pushing event deleted for resources: {'Port': ['ID=dc213cc3-7cff-4a2f-a651-e00aef4da146,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:48.596620 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33287946'] for router_gateway, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.657464 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-68b4fa5f-a0b4-40e2-aeb0-0d2a2df878a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.709198 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33089655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2033'] for router, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.711420 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.761704 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33089646'] for router, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.762174 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 041ba8d6-e5f1-480f-ae0e-3fd162f300ce {{(pid=102787) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:24:48.766490 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] Publish callbacks [] for router, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.767819 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-3fd10e79-b980-4bf0-8fa7-026f354af2ae admin admin] 10.222.0.72 "DELETE /v2.0/routers/041ba8d6-e5f1-480f-ae0e-3fd162f300ce HTTP/1.1" status: 204 len: 168 time: 0.8148549 Nov 24 16:24:48.771024 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42564) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:48.820429 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.db_base_plugin_v2 [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Deleting subnet 5b742b62-cf13-4ec7-95ee-ec6f148cce17 {{(pid=102787) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:24:48.825060 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.866572 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29966554'] for subnet, precommit_delete_associations {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:48.954078 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-651851'] for subnet, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.014013 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-651842', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33228958', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30799587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30258646'] for subnet, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.045107 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.048837 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/5b742b62-cf13-4ec7-95ee-ec6f148cce17 HTTP/1.1" status: 204 len: 168 time: 0.2766790 Nov 24 16:24:49.050509 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac5c14b-a787-49cb-a565-7b6b66ba5956 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b742b62-cf13-4ec7-95ee-ec6f148cce17,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:49.055169 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42566) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:49.057906 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-080fd9ff-cf60-48e6-96e8-80111078c4c6 None None] Network 32f222e2-cb5f-4dbb-a63a-596b38749221 requested from dv-cinder-818994-2-iscsi {{(pid=102789) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:49.146186 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-679841'] for network, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.220045 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Deleting port a4e07669-bd78-48f3-a7e5-d72053ca6e55 {{(pid=102787) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:49.220402 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.264988 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] DHCP port deletion for 32f222e2-cb5f-4dbb-a63a-596b38749221 request from dv-cinder-818994-2-iscsi {{(pid=102789) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:24:49.284050 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.db [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] For port a4e07669-bd78-48f3-a7e5-d72053ca6e55, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=a4e07669-bd78-48f3-a7e5-d72053ca6e55,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102787) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:49.284622 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.300603 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.plugin [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Calling delete_port for a4e07669-bd78-48f3-a7e5-d72053ca6e55 owned by network:dhcp {{(pid=102787) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:49.313398 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Deleting port a4e07669-bd78-48f3-a7e5-d72053ca6e55 {{(pid=102789) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:24:49.313776 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8794868609630'] for port, before_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.382688 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.db [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] For port a4e07669-bd78-48f3-a7e5-d72053ca6e55, host dv-cinder-818994-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818994-2-iscsi',level=0,port_id=a4e07669-bd78-48f3-a7e5-d72053ca6e55,segment=NetworkSegment(6e8b2de5-c898-4d55-ad5e-0fb6d7c56723),segment_id=6e8b2de5-c898-4d55-ad5e-0fb6d7c56723)] {{(pid=102789) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:49.383156 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33284376'] for port, precommit_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.388457 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30799550'] for port, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.398899 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Calling delete_port for a4e07669-bd78-48f3-a7e5-d72053ca6e55 owned by network:dhcp {{(pid=102789) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:24:49.416390 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Pushing event deleted for resources: {'Port': ['ID=a4e07669-bd78-48f3-a7e5-d72053ca6e55,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:49.419854 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] No DVR routers for this DVR port a4e07669-bd78-48f3-a7e5-d72053ca6e55 on host dv-cinder-818994-2-iscsi {{(pid=102787) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:49.492851 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-629323', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35258', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8794868611440', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8794868178405'] for port, after_delete {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.496885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-653694', 'neutron.services.segments.db._delete_segments_for_network-8794868623800'] for network, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.520041 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['32f222e2-cb5f-4dbb-a63a-596b38749221']}} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:49.524321 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] Pushing event deleted for resources: {'Port': ['ID=a4e07669-bd78-48f3-a7e5-d72053ca6e55,revision_number=None']} {{(pid=102789) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:49.527726 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38727f5d-9e9e-4db1-8f4b-deba7388a79f None None] No DVR routers for this DVR port a4e07669-bd78-48f3-a7e5-d72053ca6e55 on host dv-cinder-818994-2-iscsi {{(pid=102789) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:24:49.535113 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723') {'for_net_delete': True} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:49.535113 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.services.segments.db [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6e8b2de5-c898-4d55-ad5e-0fb6d7c56723') {} {{(pid=102787) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:49.544270 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8794868701260', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29966531'] for segment, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.557885 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188'] for segment, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.563906 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Releasing vlan 1046 on physical network physnet1 to pool {{(pid=102787) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:24:49.564296 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-652188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30798925'] for segment, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: Traceback (most recent call last): Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: timer() Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: cb(*args, **kw) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: return func(*args, **kwargs) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: self._notify() Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: self.callback(batched_events) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: event.method(event) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: return f(self, *a, **k) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._get(url).json() Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: return self.request(url, 'GET', **kwargs) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:24:49.566879 dv-cinder-818994-2-iscsi neutron-server[102787]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:24:49.621005 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-653671', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33229001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33143356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33288099'] for network, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.626394 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33143342'] for network, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.632098 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] 10.222.0.72 "DELETE /v2.0/networks/32f222e2-cb5f-4dbb-a63a-596b38749221 HTTP/1.1" status: 204 len: 168 time: 0.5734117 Nov 24 16:24:49.640523 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a14fd5d-f261-4e62-84fa-bf89f40a55cd admin admin] Pushing event deleted for resources: {'Network': ['ID=32f222e2-cb5f-4dbb-a63a-596b38749221,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:49.705212 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device f4a3ed40-460c-400c-bbfa-2e2503120f37 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:49.726573 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: f4a3ed40-460c-400c-bbfa-2e2503120f37 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:49.726916 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device f4a3ed40-460c-400c-bbfa-2e2503120f37 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:49.727335 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device a4e07669-bd78-48f3-a7e5-d72053ca6e55 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:49.744942 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42570) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:49.746674 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: a4e07669-bd78-48f3-a7e5-d72053ca6e55 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:49.747026 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device a4e07669-bd78-48f3-a7e5-d72053ca6e55 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:49.747451 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc213cc3-7cff-4a2f-a651-e00aef4da146 no longer exists at agent ovs-agent-dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:24:49.766751 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.plugin [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] No Port match for: dc213cc3-7cff-4a2f-a651-e00aef4da146 {{(pid=102789) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:24:49.767087 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron.plugins.ml2.rpc [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Device dc213cc3-7cff-4a2f-a651-e00aef4da146 not bound to the agent host dv-cinder-818994-2-iscsi {{(pid=102789) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:24:49.791075 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-cff9081a-7b8d-4aae-b064-872413e574e6 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=7ae2d50102bf491986834edf07a6a868&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0447049 Nov 24 16:24:49.793384 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42572) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:49.839597 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.860825 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.907880 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.911511 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:49.912658 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/300087a9-aaaf-42c3-8a12-e2ed85b9c55a HTTP/1.1" status: 204 len: 168 time: 0.1183593 Nov 24 16:24:49.921135 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a898ba11-3f43-49ab-955b-dfd7ee8d4b1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=300087a9-aaaf-42c3-8a12-e2ed85b9c55a,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:50.239141 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42578) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:50.278329 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-8f9b769f-a8d4-49a4-97a1-0a98222d94c9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=aca002fad1b1436093645ee6f6cbd831&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0379646 Nov 24 16:24:50.280741 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [-] (102787) accepted ('10.222.0.72', 42580) {{(pid=102787) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:50.325189 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:50.345308 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:50.393048 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33227298'] for security_group, after_delete {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:50.396278 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron_lib.callbacks.manager [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] Publish callbacks [] for security_group, before_response {{(pid=102787) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:50.397390 dv-cinder-818994-2-iscsi neutron-server[102787]: INFO neutron.wsgi [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8ad3fea5-51a4-4e3a-abf2-4fab045453ac HTTP/1.1" status: 204 len: 168 time: 0.1157315 Nov 24 16:24:50.404591 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf1834f-92ae-4fe3-be9e-a8b6f16595ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ad3fea5-51a4-4e3a-abf2-4fab045453ac,revision_number=None']} {{(pid=102787) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:51.307057 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9abda4ec-8d84-4d96-927c-94cf553d3e9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:52.716696 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:54.395212 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:54.535829 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.992307 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:25:14.474257 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:18.660228 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-a6ec7333-7014-4fa4-8571-dde4b08d3fe6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:21.308116 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d4bbe7f2-7e58-4249-b490-da0138426fe6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:22.718440 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:24.397081 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:24.538130 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:38.993540 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:25:44.466319 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.661090 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-6ca77f24-3201-4b65-b764-89a87efa4999 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.308180 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0de9db51-1f2d-4029-9e59-4a5d520c7c15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.719498 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:54.400324 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:54.537243 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.489002 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.992770 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:26:18.663167 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0e0423ee-3e40-48a6-9ac1-e8a230cb9ce6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:21.309101 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b96d8f2e-5abe-4b8f-b8c7-83c6a805bd48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:22.722936 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:24.402010 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:24.540839 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:44.502707 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:48.665249 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-d0847bca-922a-4f03-a8de-5839c346e947 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:51.309809 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-19844a8c-9ad3-4f40-bd40-4d08bfbaf67f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:52.726656 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:52.991102 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:26:54.407038 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:54.543717 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:14.506170 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:18.665892 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2fe2a126-fb61-4603-9b83-c9420d7c8691 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:21.313731 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-2e4ea11a-591e-41d9-a508-017b7be9a9c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:22.728830 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:24.400324 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:24.546697 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:29.988947 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:27:44.493946 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:48.667824 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-738af32b-d700-43fd-918b-a7db5b6984ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:51.315194 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-0afe90f8-3c18-4dd0-af4f-83821a237aaf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:52.731660 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.403092 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.549669 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:06.987966 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:28:14.516477 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:18.668822 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-77a66143-6e1d-46fa-90bd-6b9ed36cdee6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:21.316244 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-51f520db-d900-42ee-99d3-836f4acbbc42 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.734258 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.405721 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.551638 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.987294 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:28:44.516339 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:48.670028 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fa6f58db-375b-42ed-adf5-ffbbb505e67b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:51.320159 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-bd786015-4cfb-42cd-bce8-e3cd43b92ade None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:52.737933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:54.407019 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:54.555333 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:58.056816 dv-cinder-818994-2-iscsi neutron-server[102787]: DEBUG neutron.wsgi [req-819b2c56-8b52-4657-bb19-523094e4341b req-4922ad61-e082-46f9-af83-8620338764c9 service neutron] (102787) timed out ('10.222.0.72', 39186) {{(pid=102787) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:29:14.516783 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:18.671515 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-fa047cbb-519c-47a1-b564-8a04567b25a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:19.837083 dv-cinder-818994-2-iscsi neutron-server[102788]: DEBUG neutron.wsgi [req-e2d92258-eae5-4a83-86fd-4ecc36ac26b6 req-581a93d0-b79c-4464-bb21-7857749a0b47 service neutron] (102788) timed out ('10.222.0.71', 55200) {{(pid=102788) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:29:20.985967 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:29:21.323452 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-620f1049-b602-4139-9c86-8df4d422bd73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:22.739889 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:24.407528 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:24.558933 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:44.514252 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-429e9d66-7dc4-428d-8661-11e11c8ad4f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.672654 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-9f0c1bb9-2131-4865-aedd-461d3149d9e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:51.324614 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-24381f3c-1d8e-40ac-822c-5caeca56a52b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:52.743124 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-3c46bdea-b0a6-4d75-81c3-150e64298b14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:54.529312 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-b1113df6-7baa-4904-bf09-358fd0a6de3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:54.560690 dv-cinder-818994-2-iscsi neutron-server[102789]: DEBUG neutron_lib.callbacks.manager [None req-4e2874ab-9913-4f56-87a8-045a81a1bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8794868623809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-655184'] for agent, after_update {{(pid=102789) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:57.985504 dv-cinder-818994-2-iscsi neutron-server[102790]: DEBUG neutron.db.agents_db [None req-8fb6ba9a-b3ed-4d4f-ad32-eb19d06c3c90 None None] Agent healthcheck: found 6 active agents {{(pid=102790) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}